They do have an affect on ball performance, how much can be argued but they do have an affect.
I’ve never understood why this is such an issue. Any driller with his salt can balance a ball easily.
But so many drillers/bowlers must be too cheap to buy a scale, too lazy to weigh the ball, or incompetent in proper drilling.
Many times the manufactures drilling suggestions want the hole drilled in order to change core balance and get the reaction they are seeking, not just for static balance.