In my experience, there is no EASY way. Those things sit in there pretty good, and it's very easy to inadvertently gouge the sides of the thumb hole. However, yes, aside from drilling them out, using a thin flathead and some needle nose seems to work best.