This could be solved by legislation, you know. Governments across the world could decide that not respecting robots.txt is malicious activity akin to DDoS, and treat it legally as such.

...but why would they do that? Governments don't exist to serve you.