23

For me at least, for months now, this instance is unavailable for multiple hours a day. Given the recent posts about the lemmy eco system being on a slight downwards trend, I don't think this additional load is caused by more users using this instance. Rather, I think that AI scrapers are using this instance to scrape lemmy. If I am correct, though only someone with access to the logs can check, I'd like to kindly ask for some sort of protection from AI scrapers. Both because I like being able to actually browse the instance and because I hate AI companies.

top 11 comments
sorted by: hot top controversial new old
[-] TheDude@sh.itjust.works 3 points 21 hours ago

Hey all,

I am very well aware of the slowness and timeouts that people are experiencing. I'm working on getting a few upgrade put into place to bring things back to where they need to be. Thanks for the patience!

[-] WolfLink@sh.itjust.works 20 points 4 days ago

I use an app for my Lemmy browsing and I’d really like that to not break :/

[-] artwork@lemmy.world 2 points 4 days ago* (last edited 4 days ago)

I am not sure how an app crashing is related to a certain Lemmy Community, but just in case there's a marvelous Thunder (source) that is working like a charm ✨

[-] nao@sh.itjust.works 1 points 4 days ago

As an alternative, is it possible to disable the guest mode (reading without being logged in) on a lemmy instance?

On the downside, it would make it less accessible for new users or users who simply don't want to use an account. But maybe it would be worth it, if it would help to stop scrapers.

Or the middle ground, have a captcha only in front of of the guest mode.

[-] partial_accumen@lemmy.world 14 points 4 days ago

Some Lemmy instances use Cloudflare for protection. I know that sopuli.xyz uses Anubis instead. Both these approaches would offer scraper protection without a captcha which would certainly be a high friction event for human users. Does shitjustworks use something like this?

[-] artwork@lemmy.world 2 points 4 days ago* (last edited 4 days ago)

Related: Army of AI crawlers (...are extremely slowing us; AI crawlers learned how to solve the Anubis challenges... - Codeberg...)

[-] sbv@sh.itjust.works 10 points 4 days ago

I've noticed the slowness too. It's lousy, because this is the instance I recommend to normies.

But picking a solution without knowing the problem is a bit premature.

[-] smuuthbrane@sh.itjust.works 5 points 4 days ago

Will that fix all the timeout issues sh.itjust.works has had?

[-] Quacksalber@sh.itjust.works 3 points 4 days ago

The hope is that yes, it would.

[-] Pandantic@midwest.social 2 points 4 days ago

You all should @ your instance admin.

this post was submitted on 21 Jan 2026
23 points (92.6% liked)

sh.itjust.works Main Community

8347 readers
3 users here now

Home of the sh.itjust.works instance.

Matrix

founded 2 years ago
MODERATORS