A matter of social acceptability in general. Some societies, moreso before Western norms became widespread, don't view the breasts in a sexual way and a woman going topless would be completely unremarkable.
Other than the breasts, some societies see the legs as very sexual, so they always cover the legs in public.
I think it would be more likely to change in a female-dominant society, but they could just as well not change it for no obvious reason. I'm sure there's some nuance I'm glossing over, but even though it's legal for me to go out in my underwear as a man in a male-dominated society, I wouldn't do so voluntarily, regardless of the temperature.