Ads make the web human hostile and such disgraceful behaviors by scrapping bots force to make it bots hostile too.

I am sad and depressed. I went into AI to solve the problems of the world and I still think that the progresses made in machine learning are a huge too to improve the world, but seeing what capitalism turned these tools into... sigh.

I don't even have the strength anymore to explain that "AI companies" and "AI"are not the same thing...

There should be ways to behave correctly. Robot.txt should be legally enforced, rate limitation should be respected and prosecuted. Sites with information they are willing to share with models should just provide a datadump and individual requests should be reserved for human usage.

But an internet where everyone is understanding and each other and business actors do not act like psychopaths does not exist.