[-] RoundSparrow@lemmy.ml 13 points 1 year ago* (last edited 1 year ago)

Let the servers keep crashing, tell everyone to add new instances to help with performance, which puts 1500 rows into the database tables that used to have 50 rows and invokes a massive federation 1-vote-1-https overhead... causing more crashing... all the while ignoring the SQL design of machine-generated ORM statements and counting logic hidden in the background triggers.

... keep users off your sever as a method of scaling by crashing. It's one of the more interesting experiences I've had this year! And I spent all of February and March with the release of GPT-4... which was also interesting!

[-] RoundSparrow@lemmy.ml 13 points 1 year ago* (last edited 1 year ago)

This basically shuts my idea down

it's not very difficult to modify the code for something like this.... and closing off registration wont' let anyone else login and create new content form your istance.

Personally the load on the major servers by having one more instance that subscribes to everything is why I think people should back off from creating more than the 1500 instances Lemmy network already has. Delivery of every single vote, comment, post 24 hours a day just so one person can read content for an hour or two a day.

That makes sense for email systems where all that content doesn't have to be sent, but for Lemmy it's a huge amount of overhead.

[-] RoundSparrow@lemmy.ml 14 points 1 year ago* (last edited 1 year ago)

!sdfasdf isn’t a community?

EDIT: we did it Lemmy!!! !sdfasdf@lemm.ee

Me and my brother were talking to each other
About what makes a man a man
Was it brain or brawn, or the month you were born?
We just couldn't understand

[-] RoundSparrow@lemmy.ml 15 points 1 year ago

I miss the days when the internet was populated largely by nerds aiming to make a better world

The BBS and early Internet days were dominated by people who read non-fiction books. RTFM was a common saying in those days.

does anyone else feel enslaved?

“Everything in our background has prepared us to know and resist a prison when the gates begin to close around us . . . But what if there are no cries of anguish to be heard? Who is prepared to take arms against a sea of amusements? To whom do we complain, and when, and in what tone of voice, when serious discourse dissolves into giggles? What is the antidote to a culture’s being drained by laughter?”
Neil Postman
Amusing Ourselves to Death

[-] RoundSparrow@lemmy.ml 13 points 1 year ago* (last edited 1 year ago)

Things have been incredibly unstable there.

I wish lemmy.ml (also unstable) or lemmy.world would hand out a (nearly) full copy of the database so we can get more analysis done on PostgreSQL performance behaviors. Remove the private comments and password /2fa/user, or whitelist only comments/posts/communities/person tables - but most everything else should already be public information that's shared via the API or federation anyway. it's the quantity, grouping, and the age of the data that's hard to reproduce in testing. And knowledge of other federated servers, even data that may have been generated by older versions of Lemmy that new versions can't reproduce.

It's been over 60 days of constant PostgreSQL overload problems and last week Lemmy.ca made a clone of their database to study offline with AUTO_EXPLAIN which surfaced a major overload on new comments and posts related to site_aggregates counting (it was counting each new post/comment against every known server, not just the single database row for a server).

I have an account over on World too, and every major Lemmy server I use throws errors with casual usage. It's been discouraging, I haven't visited a website with this many errors in years. Today (Sunday) has actually been better than yesterday, but I do not see many new postings being created on lemmy.ml today.

[-] RoundSparrow@lemmy.ml 13 points 1 year ago

There are so many trends with technology that seem to favor another 1930's Europe situation. The 1940 film "The Great Dictator" describes it pretty well, and it is sad how much love and compassion seem to be out of favor as people march more and more towards mechanized hate-driven systems of society. I really hope a pro-humanism civil rights movement takes hold, like Martin Luther King Jr's kind of teaching, but it seems to not happen that a popular person like that comes to the top. Even a Carl Sagan type person with mass popularity to much of what Sagan shared in his books and speeches would be a good direction.

[-] RoundSparrow@lemmy.ml 13 points 1 year ago* (last edited 1 year ago)

Heads-up that a new issue on GitHub reporting this problem upgrading from 0.18.2 to 0.18.3:

thread 'main' panicked at 'Couldn't run DB Migrations: Failed to run 2023-07-08-101154_fix_soft_delete_aggregates with: syntax error at or near "trigger"', crates/db_schema/src/utils.rs:221:25 note: run with 'RUST_BACKTRACE=1' environment variable to display a backtrace

https://github.com/LemmyNet/lemmy/issues/3756

If you use "Lemmy from scratch" install,

you may be on an older PostgreSQL that Ubuntu distro provides, not the same as the Docker install method.

[-] RoundSparrow@lemmy.ml 12 points 1 year ago

You are speaking as someone who is home, transportation, and water secure. Someone with a marginally less stable life

Exactly. I'm in Arizona right now and it's incredibly hot with no break from the heat. Equipment overheating is a real issue, my development computers and phones have all had problems.

[-] RoundSparrow@lemmy.ml 14 points 1 year ago

Up until early July, Lemmy was damned if you do, damned if you don't. Federation had massive performance overhead due to some bugs and each additional instance that went online and subscribed to the big 4 popular servers was causing an even worse load problem than if say 30 users had joined directly. Especially instances that wanted a fully populated All listing, that meant every single thing was being sent to the server even if nobody was really reading that stuff.

And things like searching for topic content are going to be pretty limited given these newer servers don't have much history.

The aftermath of this attempt to scale is that there is also likely a lot of duplicate data, conversations that are mostly repetitive and posts to the same topics. Let alone the bugs Lemmy has federating deletes and moderation removal that doesn't impact direct users on the main servers as much.

[-] RoundSparrow@lemmy.ml 13 points 1 year ago

The "Hot" sort topic:

[-] RoundSparrow@lemmy.ml 14 points 1 year ago

The JWT are likely a hot issue, already some Issues on GitHub about them not being revoked properly.

1
submitted 1 year ago by RoundSparrow@lemmy.ml to c/mods@lemmy.world

I've been spot-checking consistency of replication between servers by looking at the same community on two Lemmy instances, sorting posts by new.

!asklemmy@lemmy.ml is one of the most active communities and people frequently use it incorrectly, asking technical questions about Lemmy instead of "asking the Lemmy community" for their feedback on a topic.

In spot-checking Lemmy servers, it seems that the moderator removal of the posting is only working on the "home" server, Lemmy.ml - and other servers still show the posting in the New sort list (and I assume other sort choices? unverified).

I opened a GitHub issue about the problem: https://github.com/LemmyNet/lemmy/issues/3535

I also thought this would be a good place to raise the topic. Did anyone recall ever testing and spot-checking that moderation removal of a posting worked on multiple servers before?

Thank you.

18
submitted 1 year ago by RoundSparrow@lemmy.ml to c/news@beehaw.org
1
submitted 1 year ago* (last edited 1 year ago) by RoundSparrow@lemmy.ml to c/lemmy411@lemmy.ca
view more: ‹ prev next ›

RoundSparrow

joined 1 year ago
MODERATOR OF