mdadm kicking non-fresh disk from array, Physical disk is "removed" from mdadm raid array after a reboot

Solution Verified - Updated -

Issue

  • After a reboot, the /dev/hda2 disk was gone from the mdadm array /dev/md2

    # mdadm --detail /dev/md2
    /dev/md2:
            Version : 00.90.01
      Creation Time : Sat Sep 16 11:45:26 2006
         Raid Level : raid1
         Array Size : 5172864 (4.93 GiB 5.30 GB)
        Device Size : 5172864 (4.93 GiB 5.30 GB)
       Raid Devices : 2
      Total Devices : 1
    Preferred Minor : 2
        Persistence : Superblock is persistent
    
        Update Time : Thu Dec 16 05:57:21 2010
              State : clean, degraded
     Active Devices : 1
    Working Devices : 1
     Failed Devices : 0
      Spare Devices : 0
    
               UUID : 2693ade7:d6ab52a5:52bd9e0c:9ce447e7
             Events : 0.39983614
    
        Number   Major   Minor   RaidDevice State
           0       0        0        -      removed
           1      22        2        1      active sync   /dev/hdc2
    
  • The logs contained the following

    # egrep -i 'md2|hda2' /var/log/message*
    /var/log/messages:Dec 12 11:33:10 <hostname> kernel:  hda: hda1 hda2 hda3 hda4 < hda5 hda6 hda7 >
    /var/log/messages:Dec 12 11:33:10 <hostname> kernel: md: hda2 has different UUID to hdc7
    /var/log/messages:Dec 12 11:33:11 <hostname> kernel: md: hda2 has different UUID to hdc6
    /var/log/messages:Dec 12 11:33:11 <hostname> kernel: md: hda2 has different UUID to hdc5
    /var/log/messages:Dec 12 11:33:11 <hostname> kernel: md: hda2 has different UUID to hdc3
    /var/log/messages:Dec 12 11:33:11 <hostname> kernel: md:  adding hda2 ...
    /var/log/messages:Dec 12 11:33:11 <hostname> kernel: md: created md2
    /var/log/messages:Dec 12 11:33:11 <hostname> kernel: md: bind<hda2>
    /var/log/messages:Dec 12 11:33:11 <hostname> kernel: md: running: <hdc2><hda2>
    /var/log/messages:Dec 12 11:33:11 <hostname> kernel: md: kicking non-fresh hda2 from array!
    /var/log/messages:Dec 12 11:33:11 <hostname> kernel: md: unbind<hda2>
    /var/log/messages:Dec 12 11:33:11 <hostname> kernel: md: export_rdev(hda2)
    /var/log/messages:Dec 12 11:33:11 <hostname> kernel: raid1: raid set md2 active with 1 out of 2 mirrors
    /var/log/messages:Dec 12 11:33:11 <hostname> kernel: md: considering hda2 ...
    /var/log/messages:Dec 12 11:33:11 <hostname> kernel: md:  adding hda2 ...
    /var/log/messages:Dec 12 11:33:11 <hostname> kernel: md: md2 already running, cannot run hda2
    /var/log/messages:Dec 12 11:33:11 <hostname> kernel: md: export_rdev(hda2)
    /var/log/messages:Dec 12 11:33:11 <hostname> kernel: md: considering hda2 ...
    /var/log/messages:Dec 12 11:33:11 <hostname> kernel: md:  adding hda2 ...
    /var/log/messages:Dec 12 11:33:11 <hostname> kernel: md: md2 already running, cannot run hda2
    /var/log/messages:Dec 12 11:33:11 <hostname> kernel: md: export_rdev(hda2)
    /var/log/messages:Dec 12 11:33:12 <hostname> kernel: md: considering hda2 ...
    /var/log/messages:Dec 12 11:33:12 <hostname> kernel: md:  adding hda2 ...
    /var/log/messages:Dec 12 11:33:12 <hostname> kernel: md: md2 already running, cannot run hda2
    /var/log/messages:Dec 12 11:33:12 <hostname> kernel: md: export_rdev(hda2)
    /var/log/messages:Dec 12 11:33:12 <hostname> kernel: md: considering hda2 ...
    /var/log/messages:Dec 12 11:33:12 <hostname> kernel: md:  adding hda2 ...
    /var/log/messages:Dec 12 11:33:12 <hostname> kernel: md: md2 already running, cannot run hda2
    /var/log/messages:Dec 12 11:33:12 <hostname> kernel: md: export_rdev(hda2)
    /var/log/messages:Dec 12 11:33:12 <hostname> kernel: md: considering hda2 ...
    /var/log/messages:Dec 12 11:32:26 <hostname> fsck: /dev/md2: clean, 2222/647680 files, 290857/1293216 blocks
    /var/log/messages:Dec 12 11:33:12 <hostname> kernel: md:  adding hda2 ...
    /var/log/messages:Dec 12 11:33:12 <hostname> kernel: md: md2 already running, cannot run hda2
    /var/log/messages:Dec 12 11:33:12 <hostname> kernel: md: export_rdev(hda2)
    /var/log/messages:Dec 12 11:33:13 <hostname> kernel: md: considering hda2 ...
    /var/log/messages:Dec 12 11:33:13 <hostname> kernel: md:  adding hda2 ...
    /var/log/messages:Dec 12 11:33:13 <hostname> kernel: md: md2 already running, cannot run hda2
    /var/log/messages:Dec 12 11:33:13 <hostname> kernel: md: export_rdev(hda2)
    /var/log/messages:Dec 12 11:33:13 <hostname> kernel: EXT3 FS on md2, internal journal
    

Environment

  • Red Hat Enterprise Linux (RHEL) 4, 5, 6, 7, 8, 9 and 10

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content