24

cross-posted from: https://sh.itjust.works/post/36939944

Good evening everyone!

Quick announcement to inform everyone that I will be upgrade this instance to 0.19.11 this coming Friday May 2nd at 8PM EDT.

I'm expecting about 30 minutes of downtime for this upgrade.

I'll providing real time updates via our matrix channel should any of you want to join and keep me company.

Thank you!

65

cross-posted from: https://sh.itjust.works/post/35952239

Hey all,

Today, I’m writing to share our intention to join Fedecan, a Canadian not-for-profit organization committed to supporting the Fediverse. We believe this partnership will foster collaboration among like-minded individuals who share a common goal: to create a safe, welcoming space where people can connect freely.

Together we will help deliver a fast, reliable, and consistent experience for all and continue to be free from corporate influence and guided by the values of openness, community, and trust.

Who is Fedecan

Fedecan is a registered non-profit organization based in Canada, with the goal to provide a safe and welcoming space for people to connect with each other on the Fediverse. More information can be found here.

You may also know them by their Canadian lemmy instance lemmy.ca.

What does this mean for sh.itjust.works?

From the outside everything will stay much the same, especially with the admin team. Internally, we will collaborate on tasks related to non-profit compliance, policies, banking and common infrastructure elements such as backup/disaster recovery infrastructure. We will continue to operate separate equipment and instances in geographically isolated locations under different names. We will work towards aligning on safety and security practices in order to ensure that data is secure.

From an organizational structure, sh.itjust.works will fall under the Fedecan umbrella and will share common bylaws, policies, methodologies on best practices, security and legal considerations.

Where do donations go?

Donations to sh.itjust.works will continue to support our mission and objectives exclusively. However, users will also have the option to donate directly to Fedecan, which will allocate funds amongst its projects including sh.itjust.works. Operational costs related to running the non-profit will be shared among projects and these expenses will be transparently disclosed in annual reports published on the Fedecan website.

Option to withdrawal

sh.itjust.works will have the right to withdraw from the Fedecan umbrella should our mutual goals no longer be aligned. In such a case, a predefined provision and action plan will be in place to ensure a smooth transition back to independence.

Why Now?

As the Fediverse continues to grow, we believe it's important to collaborate more closely with others who share our values. Joining Fedecan allows us to do just that, strengthening our operation through a non-profit while staying true to our mission.

Timeline / Next Steps

Over the coming weeks, we'll begin the process of integrating with Fedecan on the organization side. You won't notice many changes but we'll keep you informed throughout the process.

Looking Ahead

We’re excited about this next chapter and the opportunities it brings. By joining forces, we’re reinforcing our commitment to the Fediverse and to the principles that brought us all together in the first place—openness, community, transparency, and trust.

Our core mission remains unchanged. We're still independent in spirit and practice and we remain committed to being a space that's not driven by profit, but by people.

I invite your questions or concerns on this thread or on our https://matrix.to/#/#sh.itjust.works:matrix.org)

Stay connected,

--The sh.itjust.works and Fedecan Team

[-] TheDude@sh.itjust.works 17 points 1 month ago

Thanks for bringing this to my attention.

I found that there were some changes to the nginx.conf file which can be seen here

it does look like its fixed in the 19.10 version of lemmy. I'll do another deep dive later tonight to see if we can just update the nginx configuration without upgrading to 19.10 and if its the case will schedule another small maintenance window this week to get it pushed out.

Thank you

362
submitted 2 months ago* (last edited 1 month ago) by TheDude@sh.itjust.works to c/main@sh.itjust.works

Hello SJW community!

I will be conducting an upgrade to the lemmy software this coming Friday, March 21st at 8:30PM EDT.

During this time we will be upgrading to lemmy version 0.19.9.

Users can expect up to 60 minute of downtime for the upgrade to complete. As always will do my best to do it in less time.

I'll be providing real time updates on our matrix channel throughout the process for those interested or who just want to keep me company.

Thank you all for being part of the fediverse and this instance.

Update: If you are seeing this, we have successfully upgraded to 19.9. About 20 minutes of downtime. Thank you all for your support and kind words.

[-] TheDude@sh.itjust.works 23 points 2 months ago

Hey!

Everything has been reviewed and we're good to move over the 19.9. I'll be posting an announcement in the coming days to give everyone a heads up. I'm aiming towards the end of this week.

[-] TheDude@sh.itjust.works 85 points 3 months ago

I want to say that I've been blown away by the amount of support that's I've received in the last 24 hours. You all have left me speechless. Thank you everyone who have donated and those who couldn't, know that being a good member of this community already more than I could ask for. Thank you!

[-] TheDude@sh.itjust.works 9 points 3 months ago* (last edited 3 months ago)

Hey there, I considered this at first but my understanding with tesseract is that this would mean we'd be proxying account credentials/tokens of other instances. I'm comfortable in doing this for our own instance but it doesn't feel I'd be a responsible human to enable it for other instances. If there was a way to be more transparent to users using it for external instances I'd reconsider. I'm open to any feedback.

edit: typo

419
submitted 3 months ago* (last edited 3 months ago) by TheDude@sh.itjust.works to c/main@sh.itjust.works

Here it is, the update I've been promising you for some time.

When I first started this instance, I wanted a place where people could come together and share their experiences, knowledge and start discussions about the things that mattered to them. A place that was not driven by corporate greed but instead by its users.

In the early days of this instance, I founded the community /c/Agora to serve as a platform where users could openly discuss instance or fediverse-related matters and advocate for improvements and changes they would like to see. I want to put emphasis on the fact that this instance belongs to all of you, now and in the future.

Most of you know that since the start of this instance I've been personally funding the costs associated with it. While a lot of you have been generous enough to ask for ways to contribute over the last year, I haven't allowed it. This reason was mainly related to time and in no rush in making donations my top priority. Over the last few months I've reflected and come to understand that for this instance to truly be about its users, it also needs to be funded by them. Today I am taking the first step by sharing more details regarding the costs associated to running this instance and sharing with you all platforms that you can use to donate towards keeping this instance running.

So here it is. I've broken the rest of this post in the following sections. Feel free to jump to whichever section are most important/interesting to you:

  • Current running cost
  • Wishful 2025 budget
  • Donations platforms
  • New announcement community
  • New front-end available
  • A special thanks

Current running cost

Note: Some of these items are paid yearly however to keep things consistent I've broken it down monthly The running costs includes everything that relates to keeping the lights on. The time the admins and moderators put in keeping this instance decent is all volunteered.

Service Description Monthly Cost
1U Server Colocation Bandwidth, Power and Space $99
Domain Name The just.works domain $4.66
Image Hosting Object storage used for the images $8.25
Email Account Used by me solely for instance related communication via email (ProtonMail) $7
External Backups Remote Backups of the entire instance $20
Hardware Repairs For the eventual drive failures. (This might need to be adjusted in the in future) $15
Total $153.91
*All amounts are in Canadian Dollars

This break down is quite conservative but as this instance continues to grows, so will its costs. I've already had to replace a drive and a power supply since switching to the new server. The current breakdown doesn't leave much room for improvements. If we get enough donations, here's what I'd do with the extra money throughout 2025. The focus is around speed, stability and general site availability. I look to do this by implementing a more robust disaster recovery strategy, add extra resources for new future hosted services and switch to a proper external email sending service to address some delivery issues during waves of new accounts.

2025 Budget

Service Description Monthly Cost Yearly Cost
1U Server Colocation Location 1 $99 $1200
1U Server Colocation Location 2 $99 $1200
Remote PBS Backup Location 3 $20 $240
Domain Name The just.works domain $4.66 $55.92
Image Hosting Object storage used for the Images $8.25 $99
External Email Sending Service Email Delivery Service $15 $180
Email Account Used by me solely for instance related communication (ProtonMail) $7 $84
Hardware Repairs For the eventual hardware failures $30 $360
Total $282.91 $3,418.92
*All amounts are in Canadian Dollars

Donations

Its taken far longer than anticipated, but it’s finally here! 🚀 For now, I’m launching with two donation platforms: Liberapay and Ko-fi. If there’s demand for additional options, I’ll gladly expand in the future.

Where your donations go:

  • 💻 Keeping this instance running smoothly (see Current running costs)
  • 🔧 Funding improvements and new features

Community-driven priorities:
You can shape how extra funds are used. Join the discussion in the /c/Agora community—your input matters!

My commitment:
I’ll personally cover any funding shortfalls to ensure this project thrives, no matter what.

Thank you for your support!

New Announcements Community 📢

As this was posted we came across a bug related to local only communities. We will circle back on this once a fix has been implemented.

~~We'll be moving away from the /c/main community for posting future announcements moving forward. Instead we'll be using the /c/announcements community. The community has been restricted to only allow posts from admins. Be sure to subscribe!~~

New Tesseract front end available

One of our members @CaptDust@sh.itjust.works raised a discussion in the /c/Agora to introduce a new lemmy front end called Tesseract. I've went ahead and added this front end for all to use. You can access it from here: https://tesh.itjust.works

A special thanks ❤️

It wouldn't feel right if I ended this post without taking a minute to thank and appreciate the admins for all that they do on this instance and the fediverse. @InEnduringGrowStrong@sh.itjust.works @kersploosh@sh.itjust.works @imaqtpie@sh.itjust.works thank you for your support, volunteering your precious time and continued dedication in keeping this a place running smoothly for many that call it their home. I'll always be in your debt!

131
SJW upgrade to v19.5 (sh.itjust.works)
submitted 8 months ago* (last edited 8 months ago) by TheDude@sh.itjust.works to c/main@sh.itjust.works

Hello sh.itjust.works community,

It’s been a while since my last update, and I owe you all a more detailed one soon. However, today I’m here to give you a heads-up about the upcoming upgrade.

Over the next 7 days, I’ll be upgrading the instance to v19.5. While this update doesn’t strictly require it, I’ve decided to take this opportunity to upgrade our Postgres database from version 15 to 16 as well. This process can be time-consuming and have take up to 2 hours to complete on other instance.

I'm optimistic that we'll complete it in less time, but to err on the side of caution, I've scheduled the maintenance window for 120 minutes.

To minimize downtime, I've split the upgrade into two phases: Phase one will cover the database update, and Phase two will handle the Lemmy code upgrade.

Note: If the database upgrade is completed in under 60 minutes, I’ll proceed with the Lemmy code upgrade during the same maintenance window.

Here's the tentative timeline:

Task Date Expected Downtime
Upgrade of Postgres Database Friday September 20 2024 @ 8:00PM ET 60-120 Minutes
Upgrade to V19.5 ~~Monday or Tuesday September 23 or 24 @ 8:00PM ET~~ ~~Up to 30 Minutes~~

During these two planned events those who want to provide moral support or who want to get periodic updates are more than welcome to join us on our matrix channel

edit: 9:23EDT - Hey all, the database and lemmy codebase has been upgraded to v19.5. The database upgrade took a lot less time than expected so I went right into upgrading the codebase. A whole bunch of background tasks are still running which might make your experience slower than usual. Things should be back to normal in the next couple of hours.

[-] TheDude@sh.itjust.works 61 points 10 months ago

Hey,

I'm due to make a post about the instances finances soon. I'll get one posted in the next bit.

I'm still covering costs out of pocket but my goal has been to have this instance fully funded by its members. I want this instance to stay true to its members, the fediverse and be put in a position where it can continue to thrive transparently without me. The admin team has been doing an outstanding job keeping this instance safe and moderated for everyone. I don't thank them enough but they are the true heroes of this instance.

As some may know, I've been working with a local non profit for the past 6 months to have them leveraged in accepting accepting donations for this instance. They have been slow to get things done but its progressing. I may end up doing what I was trying to avoid and create my own non-profit instead if that's what it takes. That direction does have its own challenges and would add additional responsibilities to my plate.

In the meanwhile, while some of the costs of the services have gone up slightly, I get joy knowing that I can continue providing this instance to all of you. I'm OK paying the costs to keeping the lights on until we can transition to donations.

[-] TheDude@sh.itjust.works 8 points 1 year ago* (last edited 1 year ago)

Yes, I'll get this done

UPDATE: here you go https://oldsh.itjust.works/

[-] TheDude@sh.itjust.works 24 points 1 year ago

There was a little hiccup this morning unrelated to the migration tonight. The Lemmy services like to be restarted every once in a while. Once we move to the new hardware I'll be able to look into implementing a better logging system and hopefully be more proactive when situations like these happen.

[-] TheDude@sh.itjust.works 28 points 1 year ago

The biggest consumer of storage on this instance is related to the image hosting which we use an external object storage provider for. The second is the database which is no were near the 2TB capacity. 1TB SSDs are cheaper than 2TB SSDs and I also didn't want to spend more than I needed. As other mentioned if we need more space or IOPs in the future, I could accomplish this by adding more drives as a quick fix. This server does not support NVME unless I leverage its PCIe ports but I don't plan on doing that. By the time this instance gets to the point where 10 SSD drives just isn't cutting it anymore I'll probably have come across another opportunities on getting a new server with better NVME support.

557
submitted 1 year ago* (last edited 1 year ago) by TheDude@sh.itjust.works to c/main@sh.itjust.works

Hello sh.itjust.works community,

Many of you have been eager to get an update about when the sh.itjust.works instance will get it's upgrade to the latest version of lemmy. Here's a update along with a tentative timeline.

In December 2023 I purchased a new server for this community. It took me awhile but I eventually made the time to get it racked at the local datacenter. For the sysadmins lingering and those interested here are the specs:

  • Dual Xeon 2.9Ghz CPUs (32 cores total)
  • 256GB ram
  • 4 x 1TB SSD in raid 10 (with room to add 6 more disks)
  • 10gbit networking

While I'm ready to proceed with the upgrade, I've decided to first migrate this instance over to the new hardware. Here are two reasons.

  1. Those of you who have been around long enough may remember that I've been running this instance on "borrowed" unused resources that were available at the time. There are no more resources available for this instance to grow.
  2. There are reports that the latest version of lemmy may use more resources. Given we are among the bigger instances, should I end up in a situation where I need to increase resources to keep things fast I'll be restricted.

Here's the tentative timeline:

Task Date Expected Downtime
Migration to new server Tuesday February 27 2024 @ 8:00PM ET 90 Minutes
Upgrade to V19.3 Thursday February 29 2024 @ 8:00PM ET Up to 120 Minutes
  • If anything major goes wrong on the 27th I will revert back the changes and bring the instance back up on the current server.
  • If anything major goes wrong on the 29th I will revert back using an earlier snapshot. If that fails, I will restore from a backup.

During these two planned events those who want to provide moral support or who want to get periodic updates are more than welcome to join us on our matrix channel

=========================================================
Update February 29 2024
We've successfully completed the upgrade to v1.9.3. I'm happy to announce that we did it in an astonishing 27 minutes, a whole 93 minutes under what was expected. The extra leg work that was done over the last few weeks combined with the better hardware definitely played a part. Looking over the processes, it looks like the service responsible for images is still doing some work so it's possible that you will come across some broken images. I'll be keeping on eye on that over the next bit and make adjustments if needed. Thank you all for the support and to all of you who kept me company on our matrix channel. Have a good evening.

=========================================================
Update February 27 2024
We've successfully completed the migration. I'm happy to announce that this instance is now running on its new hardware dedicated solely to this community! We experienced just under 40 minutes of downtime which is a whole 50 minutes less than expected. Please give this instance a chance to catch up what it missed but we should be good within the next 30 or so minutes. Thank you

[-] TheDude@sh.itjust.works 7 points 1 year ago

I've started the preparation steps to minimize the maintenance window needed for this upgrade. These operations are running some background tasks and once they are done I'll make an announcement to give everyone a few days heads up of the anticipated upgrade time and date. Should be soon.

[-] TheDude@sh.itjust.works 8 points 2 years ago

Hey,

I did some research on this.

I will not share the list of accounts as I feel its everyone right to vote and to have their own opinions whether they align with yours or not.

I will however say, Its mostly the same accounts that are down voting you. The majority of the accounts are over 2 months old with content generated by them (they do not seem like bot account). There are a few that are just 10 days old. 99% of the down votes are from other instances with feddit.uk and feddit.nl being the primary source of them.

[-] TheDude@sh.itjust.works 24 points 2 years ago

The big email email providers are not liking the amount of email coming from the server ip. The permanent fix is to use a mail sending service. I do plan on making that adjustment soon.

In the meanwhile send me a dm with your username and email address used and I’ll verify the account for you.

Thanks

54
SJW Rammy Statement (sh.itjust.works)
submitted 2 years ago* (last edited 2 years ago) by TheDude@sh.itjust.works to c/main@sh.itjust.works

Hey all,

Similar to the lemmy.world announcement, we have defederated from Rammy.

Want to discuss this more? I created a [Discussion] post for us to do just that.

[-] TheDude@sh.itjust.works 60 points 2 years ago

Hey all, I’m always excited to upgrade to the latest versions that become available. Unless the upgrade is related to security I will tend to wait a few days to give other instances a chance to share their experiences. Before upgrading I usually go over the issues that have been submitted to help understand the risks and solutions to mitigate them.

That being said the new version does bring in a whole bunch of performance gains (mostly related to the database) that i’m looking forward to.

Lemmy.world is due to upgrade later today and I plan on upgrading shortly after them (either Monday or Tuesday).

I will put up a notification up prior to the upgrade.

Thanks

2
submitted 2 years ago* (last edited 2 years ago) by TheDude@sh.itjust.works to c/main@sh.itjust.works

This instance has been upgrade to 0.18.0.

The lemmy developers have removed the built in captcha so I had to enable email verification. They will be re-implementing this feature in the next update.

Lots of new improvements in this version. The Link i wanted to share is on the lemmy.ml instance and they appear to be down at the moment. Hopefully not related to this update.

Stay tuned.

Edit: Lemmy.ml back up, Here is the post: link of the update

6

Hey all

Today, I am thrilled to share two significant developments with you that will determine our shared future.

Firstly, the issue of donations. Since the inception of this instance, your most frequent request has been the ability to make contributions to support my initiative. While initially, I had never intended to accept donations, I've come to realize the value this brings in ensuring our platform's sustainability. In response to your requests, within the next week, I will be introducing several options for those of you who wish to donate. I want to emphasize that these donations are entirely optional and will directly support our instance's operational necessities - dedicated hardware, colocation fees, email services, and more.

The second announcement needs a full disclosure: it could be an extraordinary idea or potentially not so. Since the beginning of this instance, I've seen a number of insightful posts, recommendations, and ideas that the community has put forward, often superior to what I could have conceptualized myself. Even our instance's name was born from one of your suggestions.

Frequently, I'm approached by users seeking clarity on our rules and guidelines or expressing their thoughts on existing rules. In reflecting upon this, it became clear to me that I've been attempting to determine what's best for the community. But who am I to make these decisions? Just two weeks ago, I was a user among you all. Hence, I'm moving away from the traditional role of decision-making.

Instead, I want to hand over the reins of decision-making to you - the community. I'm excited to announce the creation of a community called agora where you can express your desires for the future of this instance. It's up to you to come together, discuss, and reach a consensus. If you wish to add, remove, or modify a rule, make a post, garner support from other members, and I'll implement the change. This invitation extends beyond our immediate community - I welcome input from everyone across the fediverse. Again to be clear, I gave an example of modifying rules but this applies to anything that I have the ability to do on this instance.

As the instance owner, I only have one caveat to add - any decisions made should not jeopardize the instance's existence or result in legal complications. Aside from that, I'm eager to see where this new direction takes us.

Thank you for your ongoing support, creativity, and engagement.

5
submitted 2 years ago* (last edited 2 years ago) by TheDude@sh.itjust.works to c/main@sh.itjust.works

Like many of you, I woke up this morning to discover that our instance, along with lemmy.world, had been unexpectedly added to the beehaw block list. Although this development initially caught me off guard, the administrators at beehaw made an announcement shedding light on their decision.

The primary concern raised was our instance's policy of open registration. Given my belief that the fediverse is still navigating its early stages, I believe that for it to mature, gain traction, and encourage adoption, it is crucial for instances to offer an uncomplicated and direct route for newcomers to join and participate. This was one of the reason I decided to launch this instance. However, I do acknowledge that this inclusive approach brings its unique challenges, including the potential for toxicity and trolls. Despite these hurdles, I maintain the conviction that our collective strength as a community can overcome these issues.

After this happened, the beehaw admins and I had a good chat about their decision. While our stances on registration policies might diverge, we realized that our ultimate goals are aligned: we both strive to foster communities that thrive in an atmosphere of safety and respect, where users can passionately engage in discussions and feel a sense of belonging.

Although the probability of an immediate reversal are slim given the current circumstances, I believe we have managed to identify common ground. It's evident that, even in separation, we can unite to contribute positively to the broader fediverse community.

In the coming weeks or months, we plan to collaborate with other lemmy instance administrators to suggest enhancements and modifications to the lemmy project. Primarily, our proposals will concentrate on devising tools and features that empower us, as instance administrators, to moderate our platforms effectively.

In the meantime, while I understand may not be ideal for everyone, users who choose to participate on the beehaw instance will be required to register a separate account on their instance.

Thank you all for continuing to make this community great!

1

Common Fortigate, do better. I really love your firewall.

1

"Give it to me!" She yelled.
"I'm so fucking wet, give it to me now!
She could scream all she wanted.
I was keeping the umbrella.

** Full disclosure, not my joke but still one I love to share

view more: next ›

TheDude

joined 2 years ago
MODERATOR OF