412
submitted 9 months ago by spez@sh.itjust.works to c/fediverse@lemmy.world

I think as the community grows, more search engines will start including us!

you are viewing a single comment's thread
view the rest of the comments
[-] Valmond@lemmy.mindoki.com 8 points 9 months ago

I made a crude lemmy scanner, but as I'm using the "http api" I'm a bit stuck at servers and instances. Almost 1800 servers and IIRC (I'm on my phone) some 40.000 communities. Yay!

I know the official api docs, but I don't know how to really use it, just send a json to some server? Would love to have an easy example and I'll go from there (family, work, art, and other gets in the way).

The goal would be to figure out how to make a search engine without storing the whole lemmyverse locally.

FOSS obviously.

[-] StopSpazzing@lemmy.world 2 points 9 months ago

Sounds interesting, what's the size of lemmy stored locally with only text?

[-] Valmond@lemmy.mindoki.com 3 points 9 months ago

I don't know as the (cURL http) API I'm using is confusing for messages so I only have the servers & communities.

If I get it up and running I'll tell :-D

[-] kionite231@lemmy.ca 2 points 9 months ago

Should be less than a TB.

this post was submitted on 18 Feb 2024
412 points (89.3% liked)

Fediverse

28503 readers
72 users here now

A community to talk about the Fediverse and all it's related services using ActivityPub (Mastodon, Lemmy, KBin, etc).

If you wanted to get help with moderating your own community then head over to !moderators@lemmy.world!

Rules

Learn more at these websites: Join The Fediverse Wiki, Fediverse.info, Wikipedia Page, The Federation Info (Stats), FediDB (Stats), Sub Rehab (Reddit Migration), Search Lemmy

founded 2 years ago
MODERATORS