Unplanned downtime on horn

| | Comments (0)
so I get paged about horn during rush hour.  Nothing.  no serial.  It's on a 2 in 1u, so I can't flip the PDU port. 

I head in and that side of the 2 in 1u is /hot/   the other side is just fine.  (It feels like there is plenty of air flowing through that side, but  I don't have a meter or anything, and I can't de-rack that server without taking down it's twin)  

Anyhow, I take another server out of my van and swap disks.   New server has a LSI sas controller and intel nic, so I'm doing the necessary with the kernel to make that work now.    It shouldn't be too much longer.


Update: 21:11

Still down.  working on the kernel upgrade





update 21:37

Kernel upgrade complete, system booted, test domains up, customer domains booting.  I think we are okay. 



update 21:57

and I discovered that I screwed up IPv6.   fixed.

Leave a comment

About this Entry

This page contains a single entry by luke published on October 30, 2012 7:48 PM.

So it Begins (downtime for ingot, coral, scepter, stone, and table, moving out of he.net fremont to 55 s. market) was the previous entry in this blog.

moving servers pillar, tooth, stables, birds, and kvm out of Fremont is the next entry in this blog.

Find recent content on the main index or look in the archives to find all content.