Instead of a tech solution, why not a legal one? Place somewhere in the website that refusal to follow your robots.txt is agreement to pay you x amount of money for your content. Then combine that with the dummy page solution the other person brought up so you can record the IP address, then take them to court so they pay you. Has potential to bring you a really really nice chunk of money.
I believe that there are multiple very high profile billion-dollar lawsuits being run against AI companies right now. I don't really have the budget to sue these companies.
Instead of a tech solution, why not a legal one? Place somewhere in the website that refusal to follow your robots.txt is agreement to pay you x amount of money for your content. Then combine that with the dummy page solution the other person brought up so you can record the IP address, then take them to court so they pay you. Has potential to bring you a really really nice chunk of money.
I believe that there are multiple very high profile billion-dollar lawsuits being run against AI companies right now. I don't really have the budget to sue these companies.