36
Lemmyverse historical data? (data.lemmyverse.net)
submitted 7 months ago by SatyrSack@lemmy.one to c/fediverse@lemmy.world

I am interested in checking out the historical growth of a particular community. Lemmy Explorer crawls for data about the Lemmyverse every 24 hours or something, and that data is made available on their website. But I can only find where to download the latest data. Is there somewhere that I can find historical data? Does Lemmy Explorer archive these anywhere, or does it just overwrite the previous data each time it crawls?

top 12 comments
sorted by: hot top controversial new old
[-] andrew_s@piefed.social 3 points 7 months ago

I think it over-writes every time. If you just want subscriber numbers, I've got data going back to to last July. Let me know what community you're after, and I'll send it to you.

[-] yo_scottie_oh@lemmy.ml 1 points 7 months ago

Do you happen to have subscriber data on !caps@lemmy.world?

[-] andrew_s@piefed.social 1 points 7 months ago* (last edited 7 months ago)

Yeah, but the community started before the bot at !trendingcommunities@feddit.nl did, lemmy.world had a broken API for much of August (hence the jump), and the subscriber count never changes that much otherwise, but here's what I have:

day subs
2023-07-24 70
2023-07-26 71
2023-07-28 75
2023-08-03 76
2023-08-05 77
2023-09-03 86
2023-09-04 87
2023-09-05 88
2023-09-11 89
2023-09-29 90
2023-10-08 89
2023-10-14 90
2023-10-15 91
2023-10-18 92
2023-10-21 93
2023-10-22 94
2023-11-12 93
2023-11-17 96
2023-11-19 97
2023-11-20 96
2023-12-15 97
2024-01-05 98
2024-01-10 99
2024-03-08 100
2024-03-10 101
2024-03-11 102
2024-03-15 103
2024-03-22 104
2024-04-04 105

Incidentally, if you want to know how broken the Fediverse is right now, lemmy.ml is the only version that has both of your comments. piefed.social (my instance) has 1, lemmy.one (OP's instance) had the other one, and lemmy.world (where this community is hosted) had none (edit: this was before I made this comment, which has forced a bit of a re-sync).

[-] testAccount@programming.dev 1 points 7 months ago

Mostly because Lemmy has a hard time keeping up with the federation

https://github.com/LemmyNet/lemmy/issues/4529

[-] freamon@lemmy.world 1 points 7 months ago* (last edited 7 months ago)

Oh, right. The chat on GitHub is over my head, but I would have thought that solving the problem of instances sending every activity 2 or 3 times would help with that, since even rejecting something as a duplicate must eat up some time.

[-] testAccount@programming.dev 1 points 7 months ago

Yes but now it must wait for acknowledgement of a request (activity), before sending the next one. If one request takes 333ms means you can do max 3 requests per second. Now big instances like lemmy.world have activity above that so instances too far will perpetual lag behind

[-] SatyrSack@lemmy.one 1 points 7 months ago

I was hoping for more than just that, but any data you have on !chevron7@lemmy.world would be appreciated!

[-] freamon@lemmy.world 3 points 7 months ago

(same person on different account, just so I can preview what the table will look like)

Hmmm. This might not help you much. That community was launched on 2024-01-22, with a page full of posts, so by the time the crawler picked up on it, it was already at 501 subs, 23 posts.
It lost 15 posts on 2024-02-12 (Stamets?).
There's data missing from 2024-02-26 - 2024-03-01 (this data is from the bot at !trendingcommunities@feddit.nl; I think those days are missing because I changed it from measuring Active Users Month (AUM) to Active Users Week (AUW)).
In terms of active users, the jump on 2024-03-04 is due to lemmy.world 'upgrading' to 0.19.3.

date subs aum posts
2024-01-23 501 71 23
2024-01-24 601 103 27
2024-01-25 643 125 32
2024-01-26 663 130 33
2024-01-27 668 130 33
2024-01-28 668 130 33
2024-01-29 670 130 33
2024-01-30 670 130 33
2024-01-31 670 130 33
2024-02-01 670 130 33
2024-02-02 670 130 33
2024-02-03 672 130 33
2024-02-04 672 130 33
2024-02-05 672 130 33
2024-02-06 672 130 33
2024-02-07 673 140 34
2024-02-08 678 144 35
2024-02-09 681 150 36
2024-02-10 681 150 36
2024-02-11 698 155 38
2024-02-12 703 156 23
2024-02-13 703 156 23
2024-02-14 711 160 24
2024-02-15 711 160 24
2024-02-16 711 160 24
2024-02-17 713 160 24
2024-02-18 713 160 24
2024-02-19 714 160 24
2024-02-20 715 160 24
2024-02-21 715 160 24
2024-02-22 715 160 24
2024-02-23 715 119 24
2024-02-24 715 77 24
2024-02-25 716 48 24

[data missing]

date subs auw posts
2024-03-02 718 2 25
2024-03-03 722 2 25
2024-03-04 726 129 26
2024-03-05 732 200 27
2024-03-06 748 397 29
2024-03-07 754 437 30
2024-03-08 755 453 31
2024-03-09 756 455 31
2024-03-10 770 576 33
2024-03-11 779 631 34
2024-03-12 782 651 35
2024-03-13 785 583 36
2024-03-14 787 473 36
2024-03-15 797 476 37
2024-03-16 802 493 39
2024-03-17 807 542 40
2024-03-18 812 650 41
2024-03-19 815 431 42
2024-03-20 817 400 43
2024-03-21 819 421 44
2024-03-22 819 437 44
2024-03-23 822 484 46
2024-03-24 829 533 47
2024-03-25 831 384 48
2024-03-26 833 395 49
2024-03-27 837 431 50
2024-03-28 840 462 51
2024-03-29 849 416 52
2024-03-30 851 390 53
2024-03-31 854 414 53
2024-04-01 861 466 56
2024-04-02 865 560 57
2024-04-03 868 473 58
[-] SatyrSack@lemmy.one 1 points 7 months ago

Thanks!

It lost 15 posts on 2024-02-12 (Stamets?).

What does this mean? You are assuming that a particular user deleted their account, taking all their posts with them?

[-] freamon@lemmy.world 1 points 7 months ago

Yeah. It seems like the kind of community he'd post in. I think there was some drama between him and startrek.website, resulting in him or the admins deleting the account.

[-] Stamets@lemmy.world 1 points 7 months ago

Nope, not a community I've ever posted in. I deleted my ST.W account in January.

[-] yo_scottie_oh@lemmy.ml 2 points 7 months ago* (last edited 7 months ago)

So you’re looking for something like Subreddit Stats for Lemmy communities?

this post was submitted on 03 Apr 2024
36 points (97.4% liked)

Fediverse

28424 readers
65 users here now

A community to talk about the Fediverse and all it's related services using ActivityPub (Mastodon, Lemmy, KBin, etc).

If you wanted to get help with moderating your own community then head over to !moderators@lemmy.world!

Rules

Learn more at these websites: Join The Fediverse Wiki, Fediverse.info, Wikipedia Page, The Federation Info (Stats), FediDB (Stats), Sub Rehab (Reddit Migration), Search Lemmy

founded 1 year ago
MODERATORS