Mainzer,
As you know, I don't have one of these, but here are some suggestions you could try:
1) Actually take it down further to like 2000 or even 1000 abralon, then hit it with the 4000 pad again. This will, hopefully start the ball a little sooner, smoothing out the reaction.
2) Take it down to 1000 abralon then lightly polish it. The polish over the lower grit will again start the ball sooner the polish alone, it might still have the angularity you are looking for, just not as pronounced, especially of you hit with full polish (like you could shave in shiny, lol).
Could try these first before the weight hole as these are reversable the weight hole really isn't. Hope it works, good luck.
--------------------
Jorge300