We’ll give the upgrade new try tomorrow. I’ve had some good input from admins of other instances, which are also gonna help troubleshoot during/after the upgrade.
Also there are newer RC versions with fixed issues.
Be aware that might we need to rollback again, posts posted between the upgrade and the rollback will be lost.
We see a huge rise in new user signups (duh… it’s July 1st) which also stresses the server. Let’s hope the improvements in 0.18.1 will also help with that.
It’s working! Writing from jerboa.
The last few minutes the site seems to be very fast! Let’s hope it stays this way!
Godspeed you absolute madlads.
I am probably one of many refugees coming from Reddit. Here is hoping lemmy grows and grows well.
Amen, me as well.
See you on the other side
Thanks for everything you do, [email protected]
What is new with the updated version later today?
The difference between .17 and .18 is pretty substantial. Lemmy.world neglected to update to .18 because captcha support was not working for new account signups, so they waited for v0.18.1
https://join-lemmy.org/news/2023-06-23_-_Lemmy_Release_v0.18.0
There should be substantial performance improvements because it moves Lemmy from using websocket to HTTP API.
There are lots of other fixes and things, but that is the most substantial change.
They didn’t ‘neglect’ to upgrade. They tried several times, but had issues with each.
There should be substantial performance improvements because it moves Lemmy from using websocket to HTTP API.
Websockets largely have a lower compute cost per request, HTTP requests are slow and expensive vs just firing off data in an already established TCP connection, so this isn’t tracking for me?
Was it just the overhead of managing the websockets? Shouldn’t an API gateway be doing that anyways…?
The websocket implementation was streaming federated data to the UI in real-time, and was responsible for a bunch of bugs/UX issues that wouldn’t have been evident when there were less people on Lemmy (such as scrolling down New posts on the homepage and seeing them zoom off the screen and back a bunch of pages as new federated posts from busy instances rolled in)
Some instances were also hitting the open socket limit of their reverse proxies IIRC, which was causing some users to get stuck on a spinning loader indefinitely.
I personally used an app instead because of the bugs/ UX issues caused by the websocket implementation, but since the 0.18 update on my instance the site is so much nicer to use.
Edit:
Websockets largely have a lower compute cost per request, HTTP requests are slow and expensive vs just firing off data in an already established TCP connection, so this isn’t tracking for me?
Most browsers send keep-alive headers to request that the webserver keeps the TCP connection open - I believe for HTTP/2 and HTTP/3 the connection is automatically held open regardless. It doesn’t address the overhead caused by resending headers etc, but it’s faster than establishing a new connection each time, and ‘manages itself’ by closing the socket automatically after a period of inactivity.
Websockets are still undisputably faster though, but I think it all comes down to implementation
Great explanation, thanks!
You seem to be knowledgeable here, and I’m just onboarding to Lemmy. Is it possible for others to contribute distributed compute/networking/storage resources to Lemmy instances? (Kind of along the lines of Kafka)
I have a cluster that I largely use as nodes for various projects that I enjoy. I’d be more than happy to provision a few VMs to be nodes if such a concept exists here 🤔
Great explanation, thanks!
You seem to be knowledgeable here, and I’m just onboarding to Lemmy. Is it possible for others to contribute distributed compute/networking/storage resources to Lemmy instances? (Kind of along the lines of Kafka)
I have a cluster that I largely use as nodes for various projects that I enjoy. I’d be more than happy to provision a few VMs to be nodes if such a concept exists here 🤔
No problem 😀
I don’t think it’s possible to contribute distributed resources in a normal sense, since the ActivityPub protocol being used is server-to-server (If I make a comment on this post from
lemmy.one, thelemmy.oneserver sends that to thelemmy.worldserver, which will update it’s ‘master’ copy of the post, and then send that update to other federated servers). There’s a spec page that explains this a lot better than me if you’re interested: https://www.w3.org/TR/activitypub/#OverviewThere might be a way for you to contribute some of your spare compute power in a way that I’m not aware of (maybe one of the underlying technologies, like postgres for the db, or pictrs which is used to handle images?) but I’m not familiar with how that could work
So far, the closest thing would be mods from large reddit communities spinning up their own Lemmy instance for their users to migrate to (like programming.dev from r/programming, and lemmy.dbzer0.com from r/piracy) which helps distribute the users across servers in general without needing to necessarily explain the benefits of doing that or federation in general.
As for supporting instances in general, most are accepting donations (links usually available in the sidebar shown on an instance’s homepage) and using that money to upgrade their instance specs, or moving to a dedi server
Crossing my fingers for everything to work out well. I’m looking forward to being able to log into Jerboa.
Me too! I miss Jerboa.
How loaded are the servers? It would be good to see it maybe in the instance sidebar or a website
My outdoor BBQ Im hosting starts at the same time as the lemmy upgrade. See you all on the other side and good luck LW admin!
Good Luck! Posted 19:59 CET.
What happened? Or is this not yet done? Sorry I’m kinda lost in the whole CET timings.
No, we just have bad performance now. Upgrade will be 1.5 hours from now
Hey thank you! I really thought the upgrade has started since I’m having difficulty fetching posts and commenting.
I can’t believe you still took the time to reply to comments as busy as you are. Lemmy is really like the early days of Reddit. I hope it never change.
Replying to comments is a good way to test the responsiveness of the site… :-)
That’s true. Thanks for all your hard work man!
Thank you for monitoring this. It was very bad a few minutes ago but seems better now.
Yeah, well the bad thing is that I reverted a change I did for wefwef to work, so that might be broken now
Goodluck and thanks for the effort in all of this guys.
Finally able to register. Glad to be here.
