as I warned, hamper is moving tonight

| | Comments (0)
going down now (20:20 local time)


ugh.  that took way too long.  22:33 local time, and it's coming back up. 


Note, this was my fault.    I thought I was having serial console problems, but I wasn't.  prgmr.com policy is to set 'power on after power fail on' (so that we can always turn things on by bouncing the PDU port. prgmr policy is also to have all PDUs be remotely rebootable)    But this server was set incorrectly.  I plugged it in and went to work on the serial console, where I expected problems.   It took me a very long time to realize that the box was actually off.  

I blame the fact that I didn't schedule anyone else to stand by with me.  I think it's usually best to have one person in the data center and one person in a comfortable chair with good internet access.   This was just me, though.



Also note, I warned the customers with the following message:

We'll be moving hamper to 55 s. market tomorrow night as part of our
plan to move out of he.net Fremont.  This will give us more reliable power
and additionally will actually save us money.   He.net has the cheapest
racks around, but limits power so much that it's cheaper to go with more
expensive, higher density racks at 55 s. market.  



but I failed to notify the other prgmr.com employees properly. guh. anyhow, we have a bunch more of these to do this week. The next ones, I hope, will go more smoothly.



Leave a comment

About this Entry

This page contains a single entry by luke published on October 24, 2012 8:21 PM.

replaced bad disk in ingot.prgmr.com was the previous entry in this blog.

moving servers out of Fremont on Monday is the next entry in this blog.

Find recent content on the main index or look in the archives to find all content.