outage: April 2011 Archives

So we are preparing to move our servers from svtix to market post tower. We are going to change some of our vlan numbers during the move so we can share vlan number space with egi and run vlans over their network between the 2 sites. I changed one of the vlan numbers that I didn't think would affect the routing for everything here, but it did.

 Luckily I was able to get to SVTIX pretty quickly and fix it within an hour, but of course it was a stupid mistake and I should have done it when I was already here. I'm still planning to be here tomorrow for more of this work, which is when I should have done this, but users should be prepared for another shorter outage tomorrow. We are going to move our port with egi to a tagged port so that we can run more vlans over it for moving the servers. Anyway, sorry for the trouble. I should really know better, and in the future I will make sure to do these changes when I'm on site.
Last night our provider's (rippleweb at the herakles data center in sacramento) pdu reset somehow that cycled all of the power ports. Apparently, when they moved our servers to a different room, they also put them on a different kind of pdu than they used before and it has problems. Now they have replaced it with the old kind of pdu. Everybody should be back up by now, email us if you are still having trouble. The raid is also resyncing, so expect slow disk performance until that is done. Thanks.

About this Archive

This page is a archive of entries in the outage category from April 2011.

outage: February 2011 is the previous archive.

outage: May 2011 is the next archive.

Find recent content on the main index or look in the archives to find all content.