2026–W26 #
I guess this ... must be the half way mark of the year, being week 26?
Colocataires has an outage on Monday, PD dealt with it, but there was still stuff for me to look at over my lunch break and of course an RCA to have and action items to ... enact?
A RAID card failed and also a disk had failed in another machine, taking us from n+2 to n in just a few days, and Ceph (rightly) wouldn't accept writes in this state so everyone's machines stalled. (But did not lose data!). Alas.
I've also moved some of my monitoring away from Uptime Kuma (a big JavaScript thing that I need to run in a Docker container) to just Blackbox Exporter. I didn't know this existed (found out about it from work) and that's cool because I was just about to write my own version of this which probably would have been worse.
I should remember that if I have need of a tool, I am likely not the only person.
I finally have good braking on my bike! All of this pain and it turns out that it was due to slack in my braking cable routing. The cable was too long and I left it that way because I didn't have the right tools to cut the cable sleeve. Anyway, I used the wrong tools anyway and shortened it by a few inches and now I can stop without any drama. So I probably bought two new wheels for nothing. They are nice wheels though, although the fixed side of the rear wheel was unusable. At least I kept the old ones. Spares!