(De)centralisation of Lemmy communities in numbers

Ada · 8 months ago

(De)centralisation of Lemmy communities in numbers

Tiff · edit-2 8 months ago

Relevant: https://reddthat.com/comment/8316861 tl;dr. The current centralisation results in a lemmy-verse theoretical maximum for of 1 activity per 0.3 seconds, or 200 activities per minute. As total transfer of packets is just under 0.3 seconds between EU -> AU and back.

Edit: can’t math when sleepy

Ada · 8 months ago

Oh, now that’s fascinating, and explains some of the issues we’re having. Our hosting provider had some issues, so all of our queues were delayed. It took us a while to recover, but we got through all of the outstanding queues, except for lemmy.world, which still has a huge amount outstanding. And I’m guessing that’s because we’re processing them only slightly faster than new ones enter the queue!

Tiff · 8 months ago

Since the 11th @ 9am UTC, LW has seen a 2 fold increase of activities. If my insider knowledge is right (and math) it’s 7req/s average up from 3req/s.

Lucky for both of us we are not subbed to every community on LW but I think we are subbed just enough to be affected.

Kierunkowy74 · 8 months ago

Now available as a table!

db0 · edit-2 8 months ago

They ignored lemmy.dbzer0.com

poVoq · 8 months ago

I think they included it as “/0”

db0 · edit-2 8 months ago

Oh right. That’s an interesting shortcut I didn’t think to look for. Or maybe it was edited in? I remember looking for piracy

@[email protected] · 8 months ago

How dare they!

@hamid · 8 months ago

I’m extremely grateful for all the work Ruud and his team has done to make Lemmy.world possible but I see the limitations in it that I didn’t understand 9 months ago when I started. My communities are all pretty small and I guess I can just start over but I wish there was a way to migrate my comm to a new instance with my subscriber lists and posts so that I can move my sillyness to a small well maintained instance

@[email protected] · 8 months ago

Hello,

I migrated a few communities in the past. Usually, it’s okay, except if you really have a lot of valuable content, it happens quite smoothly.

If people ask, it was from [email protected] to [email protected]

@hamid · edit-2 4 months ago

deleted by creator

@[email protected] · 8 months ago

Negative:

Ask the community if they would be okay to move. If there is a big backlash, just stay there.
Open the new community on the new instance, add the sidebar, the banner, everything to make it look like the previous one.
Post the the old community a link to the new community. Lock the old community.
Add a few posts to the new community to make the transition smoother

@hamid · 8 months ago

Ah I see, that isn’t really what I had in mind, bummer. That to me is starting over which is I guess the plan. Thanks!

@[email protected] · 8 months ago

If you just cross post everything, most of the people will stay on the previous one

@[email protected] · 8 months ago

Sadly still stuck on the OG lemmy.ml. Still waiting impatiently to be able to migrate my account to an another smaller instance.

Ada · 8 months ago

What do you mean waiting to migrate?

Post history migration will never be implemented. But you can already use apps to move over your subscribe lists etc.

@[email protected] · 8 months ago

With 0.19, you can even move your subscribe list in two clicks from the settings (you get a JSON file that you can import on another instance) without external apps

@[email protected] · 8 months ago

Oooh :c

@[email protected] · 8 months ago

What’s so bad about lemmy.ml?

xor · edit-2 8 months ago

I assume the usual complaint, which is that it’s the one of the only major servers where tankies are prevalent.

That’s, of course, not to suggest that even a majority of its users are tankies or that there aren’t plenty of great communities there, but the users who are tankies seem to be almost entirely split between lemmy.ml and lemmygrad.

@[email protected] · 8 months ago

Thanks for sharing, and happy to see two of the communities I’m posting to on Lemm.ee are mentioned there ([email protected] and [email protected] )

The centralization on Lemmy.world can create performance issues. Reddthat has been having issues since LW upgraded to 19.3: https://grafana.lem.rocks/d/edf3gjrxxnocgd/federation-health?orgId=1&var-instance=lemmy.world&var-remote_instance=reddthat.com&var-remote_software=All&from=now-24h&to=now, while they have no issues with SJW: https://grafana.lem.rocks/d/edf3gjrxxnocgd/federation-health?orgId=1&var-instance=sh.itjust.works&var-remote_instance=reddthat.com&var-remote_software=All&from=now-24h&to=now

@[email protected], our admin, is trying to figure out a solution, but it might require important rework of the Lemmy codebase

I’m thinking about asking a few communities I mod on LW if they could consider moving to another instance to spread the load.

@muntedcrocodile · 8 months ago

The centralisation should be fine but definatly something to keep an eye on.