I have to agree. When you say something like, "he was probably from the gay league," you kind of flush your own credibility down the crapper. In any case, it definitely sounds like the guy was an inconsiderate jackass, so I would've been tempted to very loudly and clearly explain why you wear what you wear in hopes that he would feel about 1/2" tall about what he had to say. Sadly though, people that ignorant and stupid are usually so oblivious that the comments may not have even phased him. As such, try to go with my rule: Don't argue with morons; it only leads to frustration. If that won't work and you just can't let it go, I would confront the guy (only with words) next time, explaining that you heard what he said, this is why you wear those things, and he can go cram it with walnuts if he doesn't like it.