You need to keep raising the grain, until it stops. In practice 2 or 3 times is usually enough for most bow woods.
If your stain/dye was water based you would in effect be raising the grain again, possibly leaving a poor finish if you hadn't done enough work beforehand.
You can put a wash coat of clear shellac, then lightly sand. Apply the stain, and it should then work well.