429
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 08 Aug 2025
429 points (99.5% liked)
Fediverse
21155 readers
14 users here now
A community dedicated to fediverse news and discussion.
Fediverse is a portmanteau of "federation" and "universe".
Getting started on Fediverse;
- What is the fediverse?
- Fediverse Platforms
- How to run your own community
founded 5 years ago
MODERATORS
Can someone explain why they would need to scrape multiple instances? Are they intentionally going after the fediverse or is it just a byproduct of meta trying to get all of human communication?
The second one
probably the latter
It's a lot easier for them to use the same scraper they use on other sites than to build something custom.
Fascism, control, having the money to trawl through less popular socials to find dissidents
Instances will not have copies of content for instances they block. So while Meta has Threads... most of the fediverse has blocked it. Since they can't get that data fia federation, they scrape. And the instances they scrape will also only have content from their unblocked instances. To ensure they get everything, they have to scrape everything regardless of federation.