From what I hear it's usually more about back-handed compliments than outright insults, like "wow, you must have a lot of confidence in yourself to wear that, go you!"