Exactly. The purpose of using a slug or insert in the thumb hole is for a consistent, smooth feel and surface. This allows you to come out of the ball more cleanly, it helps protect your thumb from getting torn up by the coarse inside of the ball, and gives you a better feel. And yes, leaving a little room for a piece of tape when your thumb changes sizes isn't a bad idea.