We’ll give the upgrade new try tomorrow. I’ve had some good input from admins of other instances, which are also gonna help troubleshoot during/after the upgrade.
Also there are newer RC versions with fixed issues.
Be aware that might we need to rollback again, posts posted between the upgrade and the rollback will be lost.
We see a huge rise in new user signups (duh… it’s July 1st) which also stresses the server. Let’s hope the improvements in 0.18.1 will also help with that.
This is like that scene in a sci-fi movie where they’re trying to repair the ship mid-battle. Good luck!
I used to work with a guy who was a sysadmin for a moderately sized webhost in the mid-2000s when things like containers and cluster orchestrators didn’t exist and high availability/multi-master database systems were only really accessible to banks.
He once described patching the servers “like trying to change all the tires on a car without being allowed to pull over”.
…as an IT guy who started my career as containers starred to be a thing, some of the stories from the late 90’s early 2000’s are bonkers. We have it so much easier with things like k8s handling the orchestration.
Watching lemmy react realtime is hella interesting, good luck y’all!
Admins be like: