Excal,
Like all good things, a little too much of a good thing is TOO MUCH. You have to use a lot more Clean & Dull on a ball and spin it a lot to get it to dull balls, but it eventally will. That's why I usually prefer it to Hook-It, which just smells and feels like Toxic Waste to me.
If you use C & D judiciously, it should not dull polished solids or pearls, and you seem to be doing that. Fine, don't worry.