I thought about this for a while and nuance is missing from my argument. I was thinking of a specific few men who were basically human garbage. Like talked down to women and treated them like objects, and also sucked ass at their jobs.

It's fine to think society should give everyone a sense of value. I disagree on the everyone part.