212
submitted 1 week ago* (last edited 1 week ago) by throws_lemy@lemmy.nz to c/linux@programming.dev

LLM scrapers are taking down FOSS projects' infrastructure, and it's getting worse.

you are viewing a single comment's thread
view the rest of the comments
[-] sudo@programming.dev 1 points 3 days ago

Most bots and scrapers from what I’ve seen already are using (headless) full browsers

That's not going to be the majority of your bot traffic by a long shot because it doesn't scale like using basic HTTP requests.

This is from personal experience. With PoW you just need any puppetted browser, maybe less. With Canvas finerprinting you need a heavily customized scraping browser, either one you made yourself or one you're paying for. If that's the case the cost of PoW is neglible. If you still want actual stats, I'd have to ask where you're getting any stats on PoW working.

this post was submitted on 21 Mar 2025
212 points (99.1% liked)

Linux

6709 readers
291 users here now

A community for everything relating to the GNU/Linux operating system

Also check out:

Original icon base courtesy of lewing@isc.tamu.edu and The GIMP

founded 2 years ago
MODERATORS