If the surfaces are properly prepared (free of oil, dust, etc. and mate correctly) the glue bond should be stronger than the wood. Handle popping off would say to me either you are either: 1) starving the joint of glue, 2) not prepping the surfaces (this includes completely removing the glue from failed glue attempts, 3) not letting the glue reach full cure (24 hours at least)
Even regular old titebond one shouldn't fail.