How does the ball roll? I don't want to bring up the years old debate, but the USBC weight rule is just some arbitrary number (or so "they" say), so I'm curious as to how the ball rolls. I don't think I've ever bought a ball that started with more than 4oz of top, so I can't imagine having one with that after drilling.
Do you use grips and slug? How much deeper did you go with the fingers and thumb?
Having fully plugged balls before, I can tell you that plug material is lighter than what was removed. How much lighter.....I don't know. I guess that depends on the type of plug. Ebonite clear plug seems to be slightly lighter than Wizard or other quick plug material.
This is what I would try, and since it sounds like you might be willing to write the ball off as a loss anyways it couldn't hurt to try.
You said the CG was in your grip center. I would drill directly on the CG with the goal of taking out at as much weight as possible.....probably a hole at least the size of a thumb insert - 1 1/4" x 3"
Last time I weighed a Vise insert it was 2.2oz, and using the Jayhawk reference chart a 1 1/4 x 3" hole will take out around 2.85oz. If you can go deeper you'll likely not have any problem taking out 3oz.
Then plug that hole. Chances are pretty good that you'll come really close to getting a full 1 oz difference...maybe close enough that you can get the rest by going deeper on thumb and fingers.
Of course doing that is going to hit the core and alter the ball dynamics. Maybe you'll get lucky and have it be the best ball you've ever thrown?
BTW, what ball are we talking about?