It's the human condition: your extremities swell and shrink to different degrees. Youth or getting older has little to do with it.
As mentioned, reduce or eliminate your intake of salted foods (french fries, potato chis, etc.) just before and during bowling. Beer used to make my fingers swell up until I literally couldn't put my finger or thumb into the ball. I stopped drinking beer during bowling for just that reason.
Normally, your thumb hole should be as large (without tape in it) as your thumb will ever get. In case you haven't found that "outer Limit" yet, carry some 100 grit sandpaper with you AT ALL TIMES!!! I have a feeling that after this situation, you will do that.
White tape is your best friend for thumb hole adjustments, even if you carry 3 different sized Switch-Grips thumb inserts. You can always put one piece of black tape, if needs be, over the white tape.