Author Topic: [SOLVED]: URGENT 810 Software RAID failed after power outage  (Read 49440 times)

Beeker

  • Guru
  • ****
  • Posts: 267
    • View Profile
Re: URGENT 810 Software RAID failed after power outage
« Reply #90 on: August 25, 2013, 10:57:36 am »
Will grab it now

Beeker

  • Guru
  • ****
  • Posts: 267
    • View Profile
Re: URGENT 810 Software RAID failed after power outage
« Reply #91 on: August 25, 2013, 11:17:36 am »
Hi Crumble,
Here you go

dcerouter_1024641:/home/# mdadm -D /dev/md1
/dev/md1:
        Version : 00.90
  Creation Time : Sun Dec 27 10:14:43 2009
     Raid Level : raid5
     Array Size : 4395407808 (4191.79 GiB 4500.90 GB)
  Used Dev Size : 1465135936 (1397.26 GiB 1500.30 GB)
   Raid Devices : 4
  Total Devices : 3
Preferred Minor : 1
    Persistence : Superblock is persistent

    Update Time : Sun Aug 25 19:10:32 2013
          State : clean, degraded
 Active Devices : 3
Working Devices : 3
 Failed Devices : 0
  Spare Devices : 0

         Layout : left-symmetric
     Chunk Size : 64K

           UUID : 5747d0ac:31c15bff:bd9f1658:0a1d2015 (local to host dcerouter)
         Events : 0.625036

    Number   Major   Minor   RaidDevice State
       0       8       17        0      active sync   /dev/sdb1
       1       8       33        1      active sync   /dev/sdc1
       2       0        0        2      removed
       3       8       49        3      active sync   /dev/sdd1
 

Crumble

  • Veteran
  • ***
  • Posts: 146
    • View Profile
Re: URGENT 810 Software RAID failed after power outage
« Reply #92 on: August 25, 2013, 11:51:06 am »
mdadm --manage /dev/md1 --add /dev/sde1


then watch the rebuild with

watch cat /proc/mdstat


let me know when it is done.  we may need to change the mdadm.conf
doubtful though, just dont reboot till we check it.

Beeker

  • Guru
  • ****
  • Posts: 267
    • View Profile
Re: URGENT 810 Software RAID failed after power outage
« Reply #93 on: August 25, 2013, 12:24:08 pm »
Tried that and got this message

dcerouter_1024641:/home/# mdadm --manage /dev/md1 --add /dev/sde1
mdadm: /dev/sde1 not large enough to join array

Crumble

  • Veteran
  • ***
  • Posts: 146
    • View Profile
Re: URGENT 810 Software RAID failed after power outage
« Reply #94 on: August 25, 2013, 01:13:00 pm »
mdadm --add /dev/md1 /dev/sde1

try this, if it says it added it watch with

watch cat /proc/mdstat
 
you should see something like this

 md1 : active raid5 sdb2[4] sdd2[3] sdc2[2] sda2[0]
         1464765696 blocks level 5, 256k chunk, algorithm 2 [4/3] [U_UU]
         [>....................]  recovery =  0.0% (84068/488255232) finish=193.4min speed=42034K/sec


Beeker

  • Guru
  • ****
  • Posts: 267
    • View Profile
Re: URGENT 810 Software RAID failed after power outage
« Reply #95 on: August 25, 2013, 03:18:47 pm »
Tried that and still got the same thing as per below

dcerouter_1024641:/home/# mdadm --add /dev/md1 /dev/sde1
mdadm: /dev/sde1 not large enough to join array
dcerouter_1024641:/home/#

Checked this as well just to give you some more info

dcerouter_1024641:/home/# cat /proc/mdstat
Personalities : [linear] [multipath] [raid0] [raid1] [raid6] [raid5] [raid4] [raid10]
md1 : active raid5 sdb1[0] sdd1[3] sdc1[1]
      4395407808 blocks level 5, 64k chunk, algorithm 2 [4/3] [UU_U]
unused devices: <none>

Crumble

  • Veteran
  • ***
  • Posts: 146
    • View Profile
Re: URGENT 810 Software RAID failed after power outage
« Reply #96 on: August 25, 2013, 04:27:04 pm »
Derp.  I forogt, the superblocks on that drive are bad so the partition needs to be rebuilt.  Since its only part of one raid just format  sde1 ext3.  Then run the add command.  It will rebuild itself and mdmadm.conf looks good.


Beeker

  • Guru
  • ****
  • Posts: 267
    • View Profile
Re: URGENT 810 Software RAID failed after power outage
« Reply #97 on: August 25, 2013, 04:29:23 pm »
Can I format it with out taking it out and putting it into another pc

Crumble

  • Veteran
  • ***
  • Posts: 146
    • View Profile
Re: URGENT 810 Software RAID failed after power outage
« Reply #98 on: August 25, 2013, 04:39:17 pm »
yeah do this

mdadm --fail /dev/md1 /dev/sde1
mdadm: set /dev/sde1 faulty in /dev/md1

then format ext3

then run the add command

Beeker

  • Guru
  • ****
  • Posts: 267
    • View Profile
Re: URGENT 810 Software RAID failed after power outage
« Reply #99 on: August 25, 2013, 10:26:47 pm »
Sorry Crumble no luck with that command see below

dcerouter_1024641:/home/# mdadm --fail /dev/md1 /dev/sde1
mdadm: set device faulty failed for /dev/sde1:  No such device

dcerouter_1024641:/home/# mdadm: set /dev/sde1 faulty in /dev/md1
bash: mdadm:: command not found

Cheers
Beeker



Crumble

  • Veteran
  • ***
  • Posts: 146
    • View Profile
Re: URGENT 810 Software RAID failed after power outage
« Reply #100 on: August 26, 2013, 01:46:38 am »
Its already marked it faulty then.  Just format ext3 then run add command.  There are four drives in the config so it should grow/rebuild itself. 

Beeker

  • Guru
  • ****
  • Posts: 267
    • View Profile
Re: URGENT 810 Software RAID failed after power outage
« Reply #101 on: August 26, 2013, 01:50:01 am »
Just confirming 

mkfs.ext3 /dev/sde1

Crumble

  • Veteran
  • ***
  • Posts: 146
    • View Profile
Re: URGENT 810 Software RAID failed after power outage
« Reply #102 on: August 26, 2013, 01:55:43 am »
That is the one :-)

Crumble

  • Veteran
  • ***
  • Posts: 146
    • View Profile
Re: URGENT 810 Software RAID failed after power outage
« Reply #103 on: August 26, 2013, 02:11:33 am »
Hey beeker,  quick question.  Since you got all that data off and have four disks,  why not go with a raid 10?  You are using that qnas for your media now right? 

Beeker

  • Guru
  • ****
  • Posts: 267
    • View Profile
Re: URGENT 810 Software RAID failed after power outage
« Reply #104 on: August 26, 2013, 05:14:27 am »
Not a bad idea, I assume no other data will magically appear after rebuilding the RAID5 and spot on moved all the data to my QNAP with 16TB of storage in RAID6

Can I rebuild the existing RAID5 to RAID10 once I get that extra HDD back into the original RAID array