luke: May 2010 Archives

ungraceful reboot of crock

| | Comments (1)
The closest thing I have to a clue right now is
May 20 04:42:07 sysl@deathboat Buffering: S32.crock [10000 from 0000020e:9e83bdb6 to 00000000:00430076.  BUG: soft lockup detected on CPU#0!    Call Trace:    [] softlockup_tick+0xce/0xe0   [] timer_interrupt+0x3a0/0x3fa   [] handle_IRQ_event+0x4e/0x96   [] __do_IRQ+0xa4/0x105   [] do_IRQ+]
May 20 04:42:07 sysl@deathboat Buffering: S32.crock [0x44/0x4d   [] evtchn_do_upcall+0x19e/0x250   [] do_hypervisor_callback+0x1e]
May 20 04:42:07 sysl@deathboat Buffering: S32.crock [/0x2c    [] show_rd_sect+0x0/0x68   [] __read_lock_failed+0x5/0x14   [<]
May 20 04:42:07 sysl@deathboat Buffering: S32.crock [ffffffff80343f3e>] get_device+0x17/0x20   [] .text.lock.spinlock+0x53/0x8a   [] show_rd_sect+0x27/0x68   [] sysfs_read_file+0xa5/0x12e   [] vfs_read+0xc]

(this is from the syslog from our serial console server, deathboat. carrage returns are messed up.) Anyhow, this mostly affects people who signed up in the last few days. Note, this was the last gasp of our socket F hardware; I put this up because i was having a hard time with the new G34 hardware. I have plenty of spares for the socket F stuff, so if it crashes again before I figure it out, I'll just replace it with other hardware and chuck the old stuff. I will update when I know more

while the rebuild finishes.  

md1 : active raid1 sde2[2] sdb2[3](F) sda2[0]
      477901504 blocks [2/1] [U_]
      [>....................]  recovery =  0.9% (4778240/477901504) finish=243.6min speed=32367K/sec


I will be /extremely surprised/ if the rebuild finishes in anything like the listed estimate.   From past experience, we are probably looking at 10 hours or so of crummy performance on hamper. 

About this Archive

This page is a archive of recent entries written by luke in May 2010.

luke: April 2010 is the previous archive.

luke: June 2010 is the next archive.

Find recent content on the main index or look in the archives to find all content.