There could also be a timing issue, you may not realize it, but you may be turning ball too soon. I know, at times I really have to pay attention on my thumb releasing before turning and lift. When you hit it right (at the exact moment), you can feel how clean your thumb comes out.
But, that may just be my own opinion.
I would first check with a qualified/professional driller though.