[Huggles web server]
And we’re back! By which I assume that the scheduled down-time while our server was migrated to another data centre has been completed without a hitch. I did intend to post here that it was going to happen, but it did in fact catch me by surprise because I thought it was supposed to be last Friday.
My only real mistake was to start reading some of the comments on the Dreamhost status blog regarding the move. Despite the fact that they were open and up front about the move – giving warning on the status page as well as by email more than 2 weeks in advance, they are still customers who feel free to bitch and moan in a most personal and horrific way. Seriously – this sort of stuff really makes me sad to see the sort of attitudes people have these days. Nowhere in the Dreamhost sales pitch does it imply that your 8 USD a month was somehow buying you a service that would be up for absolutely 100% of the time, and yet these folk think that even the best handled server downtime is grounds for some personal abuse. If I were running Dreamhost, I wouldn’t hesitate to respond to any of those “this is unacceptable” comments with “Oh I’m sorry, here’s a refund for the rest of your service, don’t let the door hit you in the arse on the way out”.
Anyway, trust in Dreamhost’s tech staff aside, my paranoia has been in high overdrive recently, so I had taken this opportunity to double check that our nightly backup procedure was working properly – and I was pleased to find it had. Which means that, should Dreamhost fall over at a critical juncture, we can fall back on our local mirror of the server and only lose work done since the previous night. Not that I’m expecting DH to fall over – they seem to have gotten on top of their random downtime issues, and since I’ve been tracking it with an external tool we’ve only been off-line for 4 hours out of the last 6 months, and no more than 2 hours in a single outage. Why don’t we just host our work locally and use an off-site backup? Well, we do a lot of collaboration with other client, and upstream bandwidth from the office is rather precious. That and the fact that Dreamhost already have quite a few mechanisms in place to restore connection and hardware problems, so they’re probably far more reliable than our local server machines anyway.
Of course, even that’s not enough for us, paranoia wise – not only do we have the primary copies in a well maintained place off site, and secondary copies in the office, we also keep physical (DVD) copies of the repositories in yet another location. Of course the first two are all automated, but the third requires me to actually go over and poke the office server to make a DVD and take it away with me. Unfortunately my attempts to train the local squirrels to do automate the process for me have been unsuccessful, but I have high hopes…