I have to use a hammer to put my slugs in.
Check your bit...could be the wrong size or oversize (mismarked Chineese product?)
Check you drill press (worn spindle bushings).
Check you ball jig...if the ball is jumping around in the fixture, the hole will end up oversize.
--------------------
Jon (in Ohio)
aka: Rico Swerve~