Women of color do get paid way less, even compared to white women

Yup. That's kind of the rub. It's not a pay gap on paper anywhere in the sense of pay scales, it's a bunch of societal biases that lead to overwhelmingly common "emergent" systemic behavior that skews women towards the lower end of the pay bands they coexist with men in while also often denying them promotions into higher positions and pay bands that are more frequently given to equal or lesser skilled men.

Very few of the individual cogs in the system are intentionally aiming for this outcome, but it's the combination of a shit ton of biases built up over generations about women and how they are expected to behave that all smashes together into the shitty end result of pay discrepancy along gender lines.

Jobs that typically women do also pay much less. Regardless of if the women in question take any time off to raise children. Or if the individual employee happens to be a man.

Teachers for example. But also human services workers and similar jobs. And this doesn't get into hiring biases for high paying jobs, like management positions in any field, which tends strongly to break for men.

The idea that women take time off from work to raise babies, and therefore they get paid less, isn't the issue, in other words. Women don't take 25% more time off then men. And not all women are having babies. But we're affected by the gender pay gap all the same.