Ya it is tough to always get a prefect fit, the good news is they don't have to be prefect, if you are using good glue it will fill any small voids if the fit isn't prefect, the main thing for me is to be sure they go all the way in without forcing them, they will split out easy in the handle if you force them in, ask me how I know.
Also like has been said making sure the belly side is flat and square before starting the cuts.
Pappy