Early Access Federation for Self-Hosters | Bluesky (docs.bsky.app)

submitted 9 months ago by ericjmorey@discuss.online to c/fediverse@lemmy.world

28 comments fedilink hide all child comments

cross-posted from: https://discuss.online/post/5484255

February 22, 2024 Bluesky writes:

Up until now, every user on the network used a Bluesky PDS (Personal Data Server) to host their data. We’ve already federated our own data hosting on the backend, both to help operationally scale our service, and to prove out the technical underpinnings of an openly federated network. But today we’re opening up federation for anyone else to begin connecting with the network.

The PDS, in many ways, fulfills a simple role: it hosts your account and gives you the ability to log in, it holds the signing keys for your data, and it keeps your data online and highly available. Unlike a Mastodon instance, it does not need to function as a full-fledged social media service. We wanted to make atproto data hosting—like web hosting—into a fairly simple commoditized service. The PDS’s role has been limited in scope to achieve this goal. By limiting the scope, the role of a PDS in maintaining an open and fluid data network has become all the more powerful.

We’ve packaged the PDS into a friendly distribution with an installer script that handles much of the complexity of setting up a PDS. After you set up your PDS and join the PDS Admins Discord to submit a request for your PDS to be added to the network, your PDS’s data will get routed to other services in the network (like feed generators and the Bluesky Appview) through our Relay, the firehose provider. Check out our Federation Overview for more information on how data flows through the atproto network.

Read Early Access Federation for Self-Hosters

all 31 comments

sorted by: hot top controversial new old

[-] doomsdayrs@cyberpunk.lol 17 points 9 months ago* (last edited 9 months ago)

@ericjmorey

"After you set up your PDS and join the PDS Admins Discord to submit a request for your PDS to be added to the network, your PDS’s data will get routed to other services in the network"

BWHAHAHAH YOU NEED TO FUCKING JOIN A DISCORD FOR THIS?

BWHAHAHAH

#bluesky #federation #discord

[-] ericjmorey@discuss.online 5 points 9 months ago

It's unclear if that's temporary (But I can't imagine them manually adding self-hosted accounts forever).

[-] doomsdayrs@cyberpunk.lol 2 points 9 months ago

@ericjmorey Nah its techbros they'd do this indefinitely until someone gives them a better idea (they can't make original things).

[-] ericjmorey@discuss.online 7 points 9 months ago* (last edited 9 months ago)

I get the skepticism. I'm not all that optimistic about Bluesky myself, but they clearly already made an original thing and other "techbros" have made original things many times.

The good news is this is all openly designed and implimented so it could be used for something potentially better.

[-] ericjmorey@discuss.online 4 points 9 months ago

Looks like you might be wrong

[-] mackuba@martianbase.net 1 points 9 months ago

@ericjmorey @doomsdayrs No, it's actually extremely clear that it is temporary…

[-] ericjmorey@discuss.online 2 points 9 months ago

The blog post didn't make that clear, but I see that it's repeated in other blog posts and on the Discord server.

[-] rikudou@lemmings.world 11 points 9 months ago* (last edited 9 months ago)

So it's a centrally controlled network? That doesn't really seem like proper federation protocol.

Or is it only to federate with their main instance? Meaning InstanceX and InstanceY can still federate with each other even without approval from the overlords.

[+] skullgiver@popplesburger.hilciferous.nl 5 points 9 months ago* (last edited 8 months ago)

[deleted]

[-] ericjmorey@discuss.online 5 points 9 months ago

The more I'm reading into the docs, the more convinced I am that the AT protocol is better than ActivityPub.

I wonder if there cound be a link aggregator and forum style implementation of the AT protocol, the same way that Lemmy did with the ActivityPub protocol.

I wonder what sort of bridging can be implemented between AT Protocol and ActivityPub implementations.

[+] skullgiver@popplesburger.hilciferous.nl 9 points 9 months ago* (last edited 8 months ago)

[deleted]

[-] Flaky@iusearchlinux.fyi 6 points 9 months ago

Yeah, from some cursory glances and following of AT devs, some things I understand the logic of and some things I'm thinking "isn't this a bit over-engineered?"

[-] dumpsterlid@lemmy.world 1 points 9 months ago

My basic question is whether the problems that needed solving about Twitter and other corporate social networks really have anything to do with software engineering at the end of the day.

Writing the code is honestly the easiest part in all probability. It is the other parts like community ownership, resiliency against corporate capture and human moderation that takes into consideration complex contexts etc… that are the truly hard parts and Bluesky really says almost nothing (at least worth trusting as more than words) new along those vital metrics (chiefly because it is an investor backed for-profit venture).

[-] Flaky@iusearchlinux.fyi 1 points 9 months ago

I think the moderation will be an uphill battle for Bluesky. I haven't seen a clear answer over how legal issues are going to be handled and generally, people want some form of moderation. Maybe not the extent that the fediverse has with its blocking drama.

But the resiliency against corporate capture and community ownership, meh I'm not really worried. I work with and use open-source projects that have been backed by corporations, Mastodon.social has already said they wish to federate with Threads, and there are corporations sponsoring (in the case of mastodonapp.uk) or outright owning instances (in the case of Flipboard, Mozilla Social and Vivaldi Social). Bluesky seems to be built on the notion that it too will be a possible adversary in the future, so the protocol is being built with that in mind.

[-] dumpsterlid@lemmy.world 1 points 9 months ago* (last edited 9 months ago)

But the resiliency against corporate capture and community ownership, meh I’m not really worried.

You have to explain to me why you think massive tech corporations are going to behave differently here than they always do. Every large tech company behaves like Microsoft after a certain size in terms of values and actions, and they will do their best to mine the valuable aspects of the fediverse out and silo them away in a way that can be monetized.

I consider Flipboard or Mozilla owning instances to be a far different question because these are relatively small corporations, they aren’t Meta, they don’t have more cash on hand than entire countries.

I think the moderation will be an uphill battle for Bluesky.

Moderation is the hard part about social media, who gets to moderate, how moderation is handled between communities and how much human moderation genuinely happens from within the context of communities are all the important questions.

Again, what happens when Bluesky’s investor’s come knocking and want monetization? At that point is the CEO really just going to say “we can’t do that, it would give us more profits but it would be wrong to undercut the openness of Bluesky!”. It is frankly ridiculous to assume this would happen, the same story will play out that always plays out here.

You can either make huge amounts of money off of social media and payback your investors or you can make a healthy community, pick one. Unless you are a massive corporation with a lottttt of investors to please, then there was never really a choice no matter how long your investors let you attempt to fool your customers into thinking so before you hit the gas on cashing in (Reddit).

[-] Flaky@iusearchlinux.fyi 2 points 9 months ago

This all implies Bluesky can be considered a massive tech corp (which it honestly isn't even with investors, definitely not compared to Meta, or even Mozilla at this point), and can even be monetised.

In the event that they do attempt that, users can move to a different PDS and not lose any of their data - that's how AT was built. While on AP, it's dependent on if the software powering the account supports migration, and even then I've not seen an implementation that carries over all of the user's data (Mastodon only does followers/following, Lemmy has no migration whatsoever). That's not to say it's impossible, but I've not seen it happen.

[-] dumpsterlid@lemmy.world 1 points 9 months ago

But what is the business model here? Can you honestly tell me with a straight face that you trust them?

After a certain point I don’t care about technical arguments about how the AT protocol is better than AP or how technical aspects of it make it impervious to being controlled, there are always ways. The way we stop it is political, not technical, and just trusting Bluesky will be benevolent towards its federated users indefinitely is not a winning political strategy here in terms of the power dynamics between the ruling class (people like Jack Dorsey) and the rest of us.

Further I bet most of the people involved in Bluesky are really passionate and genuine in their desire, but ultimately their good intentions don’t interface at all with the reality of the structure they are operating in, i.e. an investor backed corporation seeking to profit off of a social network backed by some of the richest most powerful people in the tech world (even if they haven’t directly poured huge amounts of capital into it, they could, the option is there).

You have to ask, why the hell would they be genuinely offering us the future we want for the fediverse? It makes no sense for them too since they simply stand to lose by creating that future for us.

[-] Flaky@iusearchlinux.fyi 1 points 9 months ago* (last edited 9 months ago)

Bluesky's development has been pretty democratic, moreso than Mastodon where one guy basically leads the entire trajectory of the fediverse (at least from a mainstream perspective) from what I heard.

As for Jack, hasn't been on Bluesky for a while now - he prefers Nostr. Even though he's on the board, he's not attended any meetings nor has he dictated how the platform should go. He just threw money at it and ran after the community didn't take him seriously.

[-] dumpsterlid@lemmy.world 1 points 9 months ago

Who owns it though? Who are the investors? How are they planning to recoup their investment?

[-] Flaky@iusearchlinux.fyi 1 points 9 months ago

Jay Graber is the CEO, dunno about the investors but I don't care tbh. If Bluesky does go to shit, the protocol lets me move away without losing my data.

[-] dumpsterlid@lemmy.world 1 points 9 months ago

Ok well similarly I don’t care about the supposed promises of longterm openness with Bluesky or how that openness is “locked in” by a bunch of technical details that seem to me there a million ways to undermine at a later date when again, investors come knocking.

[-] ericjmorey@discuss.online 5 points 9 months ago

It will be interesting to see what Friendica devs come up with!

I've just started looking at the AT protocol. What sort of WTF things are in there?

[-] owls@community.yshi.org 0 points 9 months ago

not the OP, but

i was going to point to the did:plc thing they made up and went with. but since the last time i looked, it looks like they support (and prefer) did:web, so that's sorted out.

the "wtf" i have is more to do with actually running a community with atproto. you need a central crawler service that knows about all the PDSes you want to be friends with (this is presumably why you need to sign up in their discord right now, they gotta tell their crawler to look at your PDS)

but i think the crawler has to grab the entire PDS for everyone it knows about? if you want a large community, it seems pretty resource-intensive since the ceiling is "infinity posts". bsky's open source code suggests they have chosen not to deal with this problem.

with most AP services (e.g. mastodon), you can prune the data and the only consequence is "you don't get full text search for super old posts received from other services that we pruned", so there are ways to limit the cost other than "limit the number of users in our community".

but this may just be an implementation detail and not an issue with atproto, e.g. git shallow clones are a thing, and the PDS is also storing a big merkel tree. i am not sure if the indexer relies on having the complete history or not (since you do need it for certain operations). bsky's own code just shrugging suggests maybe limiting it is challenging, i dunno.

[-] ElectroVagrant@lemmy.world 1 points 9 months ago* (last edited 9 months ago)

What you note about the crawler appears to be essentially by design:

The federation architecture allows anyone to host a Relay, though it’s a fairly resource-demanding service. In all likelihood, there may be a few large full-network providers, and then a long tail of partial-network providers. Small bespoke Relays could also service tightly or well-defined slices of the network, like a specific new application or a small community.

In their section on so-called "Big World" design:

As a result, we opted to architect the protocol in a “big world with small world fallbacks” way. With the web, individual computers upload content to the network, and then all of that content is then broadcasted back to other computers. Similarly, with the AT Protocol, we’re sending messages to a much smaller number of big aggregators, which then broadcast that data to personal data servers across the network.

Emphasis mine.

[-] spaduf@slrpnk.net 5 points 9 months ago

the more convinced I am that the AT protocol is better than ActivityPub.

That's because AT was very deliberately designed to solve problems with ActivityPub.

I wonder what sort of bridging can be implemented between AT Protocol and ActivityPub implementations.

The folks over at https://fed.brid.gy/ have been working at this. Much to the chagrin of the folks over at Mastodon.

[-] ericjmorey@discuss.online 2 points 9 months ago

I haven't dug into the details, but there seem to be a lot of blog posts and extensive documentation to figure it out.

[-] iopq@lemmy.world 1 points 9 months ago

I want to know this too, how does it work?

[-] crazyCat@sh.itjust.works 6 points 9 months ago

Do they still require a phone number? They didn’t let me join based on my country.

[-] ericjmorey@discuss.online 2 points 9 months ago

I just made an account with nothing more than a throwaway email address. So a phone number is not required.

[-] redcalcium@lemmy.institute 1 points 9 months ago

I was blocked from sign up too due to the phone number verifier didn't support my country, but when I tried again several days ago, they doesn't seem to require phone number anymore.

this post was submitted on 23 Feb 2024

32 points (86.4% liked)

Fediverse

28493 readers

236 users here now

A community to talk about the Fediverse and all it's related services using ActivityPub (Mastodon, Lemmy, KBin, etc).

If you wanted to get help with moderating your own community then head over to !moderators@lemmy.world!

Rules

Posts must be on topic.
Be respectful of others.
Cite the sources used for graphs and other statistics.
Follow the general Lemmy.world rules.

Learn more at these websites: Join The Fediverse Wiki, Fediverse.info, Wikipedia Page, The Federation Info (Stats), FediDB (Stats), Sub Rehab (Reddit Migration), Search Lemmy

founded 2 years ago

MODERATORS

ruud@lemmy.world

TragicNotCute@lemmy.world

Xylinna@lemmy.world

MrCenny@lemmy.world

automodbeta@lemmy.world

woelkchen@lemmy.world