... compromising it too much?

I have a Raw Hammer that was redrilled for me, but it was set up for a lefty, and I am a righty.  So, I want to drill it again for me which will be the 3rd drilling.

As a newer bowler doing about as high as a 185 avg, will this make that much of a difference??

I have a Gravity Shift that's on its third drilling.  It has too many games to count on it, the coverstock's got nicks and dings everywhere, and I track right over a couple spots of plug material.  And it's still able to cover more boards than anything else in my bag when the conditions suit it, and it still carries just as well as anything I've ever thrown.  Don't be afraid to give it a try.