The StatusCake monitoring for ttw was paused again -- I hate picking on software services but like ... it has _one_ job, and pausing an uptime check without notifying anyone makes it almost useless. I need an uptime monitoring service monitoring service.
Whatevs.
I'm DTA -- down to #admin -- Going to relocate our compute stuff from Paris to well .. Ottawa for now, and maybe pay for some uptime monitoring as I am currently getting what I pay for (nothing).
There might be some downtime. 🐿
I am also aware that Elasticsearch is mullered. That might need to be rebuilt from the ground up, and ES indexing jobs are backing up Sidekiq which is leading to memory pressure.
Who knew that keeping a Rails app running was such hard work! 😅🥵
Okay, it's looking pretty good. Thanks Docker! But I am also having electricians in tomorrow so just in case they need to knock the whole panel off, I'll wait until the middle of the week to actually move ttw over. I hope y'all can put up with the sluggish speed until then -- I know it's annoying 🙏
The power was only off for `< $ups_run_time` so it would have been fine to have moved everything yesterday after all, but now that blocker is out of the way I can move it tonight or tomorrow.
We're now running out my basement. People's home feed are rebuilding on a new, empty Redis. The old one had its Sidekiq queue drained; apart from the home feed thing this should be a seamless cut over and way faster than it's been since Friday.
We are still sending HTTP from France to Canada, which is not ideal. So, I'll look at getting a VM in North America to be our proxy in order to avoid these oceanic voyages.
Aaand now a DigitalOcean droplet in Toronto is providing us with a stable IP address and fronting the whole show (and autorenewing TLS certs, hopefully).
Those of us in North America should have the best ttw experience so far. My European friends: sorry, but also the server should be broken less often so that's also nice. ❤️
And we're done again. Let's all agree to leave things alone for a little bit 
@insom will we get search back?
@selfsame it's on my list. The old index was corrupted so I need to start from scratch, which took a few days to index last time. That said, we're on better servers now, so maybe it will be quicker.
@selfsame several days later: it's still going.
#admin intensifies: I've got a new, less phone company, router. I'll need to take some downtime tomorrow to do the swap, including moving a fibre optic SFP into a switch and hoping for the best. I can always rollback if something goes wrong. This will hopefully be the last scheduled downtime for ttw for a bit.