It has begun

| | Comments (1)
we've begun moving servers from SVTIX to Market Post Tower.

I'm starting with test servers blood and frogs,  no customers are impacted yet, but blood
and frogs and the associated rails are on my cart and about to begin the five block dash to the other data center.   

edit at 00:54: downtime for customers is beginning now for customers on beak, dow and hydra.

edit at 02:06: beak, dow and hydra are back and domains are starting up again

edit at 02:15: beak, dow and hydra are back, all domains started.  complain if you are still down.  

edit at 03:18:  lozenge, dish, crock, coat, coins, and chime  are shutting down.

edit at 3:44: dish and crock crashed, BUG: soft lockup detected on CPU#0!  unknown how many domans were shut down uncleanly.  all others in the list were shut down cleanly.

edit at 05:17: lozenge, crock, coat, coins, and chime are back up and are starting up guests.   Dish is still down.

edit at 05:46:  dish is up, guests on dish are starting
  
edit at 05:59: all guests are now up. 

  
We're moving most of our servers from SVTIX[1] to Market Post Tower[2] this
weekend.    we've got layer 2 between the two locations already, so we'll
be bringing down servers in batches of five and moving them five at a shot.  
each user should experience something like two hours of downtime, if all 
goes well.  

This, along with the bandwidth outage earlier this month puts me way
over the SLA, so all users we move will be receiving 25% of a month off.  

I am sorry for the short notice;  I've made several bad decisions
that led to this short notice, but I think I am correcting some of those.
The deal wasn't even final until two days ago, but the solution to that 
is more transparency, not less.  Well, more transparency and longer
term agreements.   I am sorry.  
 
I'm now signing a long-term contract, and I'll put data as to when these
contracts expire in a publicly accessible place, so this sort of thing
will be more predictable in the future.  

Now, market post tower is generally considered a better data center 
than SVTIX.   It's usually more expensive, It's much nicer looking and 
has /much/ better and cheaper bandwidth available.  I will immediately 
double the bandwidth "don't worry about it" allowances for everyone.   
Now, svtix has a better history for power, but CoreSite, I am assured, 
has recently upgraded the power systems and the bad old days should be 
behind us.  

In any case, I am maintaining space at both MPT and SVTIX, though SVTIX
will be largely co-location;  most of my Xen hosts will be moved to MPT.  
For now, my bandwidth at svtix will be coming from MPT, which should 
be an improvement for users still at svtix. 

please see http://wiki.xen.prgmr.com/xenophilia/  for the blow-by-blow.

[1]http://www.svtix.com/  at 250 market st. in san jose
[2]http://en.wikipedia.org/wiki/Market_Post_Tower  55 s. market in san jose

1 Comments

Are very jittery response times to be expected? I'm experiencing a lot of jitter after you guys completed the move of the machine my VPS is on.

Thanks.

Leave a comment

About this Entry

This page contains a single entry by luke published on May 14, 2011 8:28 PM.

I am replacing Table tonight was the previous entry in this blog.

move to MPT, day 2 is the next entry in this blog.

Find recent content on the main index or look in the archives to find all content.