[-] Kris@feddit.org 1 points 1 month ago

Sure, that seems reasonable. We will add that when the instance is back online.

If I forget, please remind me. For sure we will not just ignore you ๐Ÿ˜Š

[-] Kris@feddit.org 2 points 1 month ago

Regarding the price and all that, maybe that is an interesting discussion to have with the slrpnk.net community? And it would also be good to let slrpnk.net users know how the instance is being ran, what hardware, where, etc, so users can be an educated decision on whether they want to see an instance or not? Maybe providing that info on the sidebar would be nice?

We have been very transparent about that and documented that in the wiki which is linked in the sidebar. But it seems few people ever read the Wiki and having it integrated like it is with Piefed would probably help.

I agree that more admins with remote access would be good to have, and we have been working towards adding more (there are already more than one, who are not directly involved with slrpnk, but rather the mother project f-hub.org), but physical access will always be limited by the location (Azores) unless we move to an entirely different data-center (which in turn would make it hard for me to access the physical servers).

[-] Kris@feddit.org 4 points 1 month ago

Already thinking about how to make the best of it ๐Ÿคท Maybe we can use this opportunity to try and migrate to Piefed? I had this in the back of my mind for a time already and Rimu seems optimistic that it is possible.

[-] Kris@feddit.org 14 points 1 month ago

Glad that at least someone sees a positive side of it, because I sure don't... well at least it gives me a bunch of ideas how to avoid such situations in the future ๐Ÿคท

[-] Kris@feddit.org 15 points 1 month ago

Thanks, I am trying, but it really is quite annoying to lose access like that.

[-] Kris@feddit.org 22 points 1 month ago

Sort of yes. It is a homelab a few people have access to, but currently they are all either on holiday or on extended work related travel. It seemed like an acceptable risk as everything worked smoothly for years.

[-] Kris@feddit.org 6 points 1 month ago* (last edited 1 month ago)

Yeah I had plans to set up something like that, but always other priorities and in this specific case I could maybe access other internal servers but i would need KVM access to reboot the firewall or some other way to cut physical power. And exfiltrating hundreds of GBs of lemmy database wouldn't work over such a small pipe either.

[-] Kris@feddit.org 21 points 1 month ago* (last edited 1 month ago)

The feddit.de admin disappeared on a work trip to Japan. At least that is the official story.

[-] Kris@feddit.org 11 points 1 month ago

Well, on the plus side lots of lessons learned and I think I might move at least the xmpp server to an external vps to have a backup communication channel.

[-] Kris@feddit.org 12 points 1 month ago

We have backup admins, but this seems to be an unexpected hardware issue, and physical access to the servers is more restricted.

[-] Kris@feddit.org 27 points 1 month ago

Yeah, but at least I have not disappeared yet ๐Ÿ˜…

[-] Kris@feddit.org 14 points 1 month ago

Yeah, I know. Complete Murphy's law situation.

303
Slrpnk.net outage (feddit.org)
submitted 1 month ago* (last edited 1 month ago) by Kris@feddit.org to c/fediverse@lemmy.world

Alt account of poVoq@slrpnk.net here.

Our instance is currently down and I can't get remote access to the servers. It appears that there might have been a hardware failure of the main firewall, which is the one thing I can't work around remotely.

I am still trying a few things, but I am not very optimistic that I can get access.

The really unfortunate part is that just now I am on one of my rare work deployments abroad, so I also can't access it physically during the next few weeks and my usual back up that could restart it is not available either.

As something like that never happened in 3 years operating the servers, I thought I can risk it, but murphy's law seems inescapable ๐Ÿ˜“

I will try to keep you posted here on any updates, but probably there will not be much I can do for a while. Really bad timing ๐Ÿ˜ฅ

Edit: we might use this "opportunity" to migrate the instance to Piefed, which has been an idea for quite some time now. I will keep you posted on that.

view more: next โ€บ

Kris

joined 1 month ago