Until one of these AIs just starts selling other people’s work as its own, and no I don’t mean derivative work I mean the copyrighted material, nobody is breaking the rules here.

Except of course that's not how copyright law works in general.

Of course the questions are 1) is training a model fair use and 2) are the resulting outputs derivative works. That's for the courts to decide.

But in general, just because I publish content on my website, does not give anyone else license or permission to republish that content or create derivative works, whether for free or for profit, unless I explicitly license that content accordingly.

That's why things like Creative Commons exists.

But surely you already knew that.