It depends on how the hole fits you. If you've told the driller, it's good when you left the shop, then you should be able to fine tune the hole yourself with sandpaper. I use 100 grit and 150 and 240 grit to do that myself. If you need to do more than that, I suspect you need to tell the driller that the next time.
Sandpaper: I cut a piece about 3" wide by 5" long and fold it it twice so I wind up with a piece 1" by 5". I bend it along the length so my finger fits into the groove and then put it into the hole and remove material where it rubs. I do this with the 100 grit and then use the 150 grit and 240 grit to smooth it out so there's no rough surface inside. You can go to 400 grit for more smoothness.
I also use these pieces to add or increase the bevel on the inside of my thumb, as necessary.
This process is much better than the bevel sander as it removes much less material. It's far too easy to remove too much material.
"None are so blind as those who will not see." "Some bowlers are crazy as pickled cats."
