Thats not true. The history of segerated bathrooms are worse than that... during the Victorian era, public bathrooms were men only. Women were not expected to travel from their home, or carry piss pots with them. Women had to fight for their right to have access to facilities. Also employers used the excuse of lack of women facilities to not hire women. The reason segerated bathrooms exist in building codes are because of decades of women fighting for their rights...

Dont pin it on racism on good old fashion sexism.