System crashed at raid1_mergeable_bvec+0x27/0xf0
Environment
- Red Hat Enterprise Linux 6
Issue
- System crashed with the below log in the vmcore
sds: sds1
sdt: sdt1
sdu: sdu1
md127: unknown partition table
md126: unknown partition table
md125: unknown partition table
BUG: unable to handle kernel NULL pointer dereference at 0000000000000080
IP: [<ffffffffa0146027>] raid1_mergeable_bvec+0x27/0xf0 [raid1]
PGD 1858a6c067 PUD 1858943067 PMD 0
Oops: 0000 [#1] SMP
last sysfs file: /sys/devices/system/node/node1/meminfo
CPU 0
Modules linked in: fuse oracleasm(U) autofs4 sunrpc 8021q garp stp llc acpi_cpufreq freq_table mperf ipt_REJECT ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state nf_conntrack ip6table_filter ip6_tables ipv6 enic power_meter microcode sg sb_edac edac_core raid1 i2c_i801 i2c_core iTCO_wdt iTCO_vendor_support shpchp ext4 mbcache jbd2 dm_round_robin fnic libfcoe libfc scsi_transport_fc scsi_tgt sd_mod crc_t10dif wmi megaraid_sas dm_multipath dm_mirror dm_region_hash dm_log dm_mod [last unloaded: nf_defrag_ipv4]
Pid: 22554, comm: kfod Not tainted 2.6.32-358.el6.x86_64 #1 Cisco Systems Inc UCSB-B200-M3/UCSB-B200-M3
RIP: 0010:[<ffffffffa0146027>] [<ffffffffa0146027>] raid1_mergeable_bvec+0x27/0xf0 [raid1]
RSP: 0018:ffff8830596d3a08 EFLAGS: 00010292
RAX: ffff8830582f9800 RBX: ffff881854d67380 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ffff8830596d3a68 RDI: ffff883059e6afa8
RBP: ffff8830596d3a48 R08: 0000000000000c00 R09: 000000000000ffff
R10: 0000000000000001 R11: 0000000000000008 R12: ffff883059e6afa8
R13: ffff8830596d3a68 R14: ffffea0054b951a0 R15: ffff881854d673f0
FS: 00007f09a06f6700(0000) GS:ffff880028200000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000080 CR3: 0000001859b1c000 CR4: 00000000000407f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process kfod (pid: 22554, threadinfo ffff8830596d2000, task ffff8830591deae0)
Stack:
ffff8830596d3a94 ffff881854d673f0 0000000100000000 ffff881854d67380
<d> ffff883059e6afa8 0000000000000400 ffffea0054b951a0 ffff881854d673f0
<d> ffff8830596d3ab8 ffffffff811ba190 ffff8830596d3aa8 00000c0000000246
Call Trace:
[<ffffffff811ba190>] __bio_add_page+0x110/0x230
[<ffffffff811ba306>] bio_add_pc_page+0x16/0x20
[<ffffffff811ba7b6>] bio_map_user_iov+0x1f6/0x2d0
[<ffffffffa02eb000>] ? asmdisk_test+0x0/0x30 [oracleasm]
[<ffffffff811ba8b5>] bio_map_user+0x25/0x30
[<ffffffffa02ed8e5>] asm_submit_io+0x6b5/0xb40 [oracleasm]
[<ffffffffa02ee185>] asm_submit_io_native+0x95/0x1b0 [oracleasm]
[<ffffffff811bba53>] ? check_disk_change+0x33/0x80
[<ffffffffa02effeb>] asm_do_io+0xa0b/0xb10 [oracleasm]
[<ffffffffa02eb000>] ? asmdisk_test+0x0/0x30 [oracleasm]
[<ffffffff81227499>] ? selinux_inode_alloc_security+0x69/0xb0
[<ffffffff8121cf80>] ? security_inode_alloc+0x40/0x60
[<ffffffffa02eb240>] ? timeout_func+0x0/0x30 [oracleasm]
[<ffffffffa02f0232>] asmfs_svc_io64+0x142/0x2b0 [oracleasm]
[<ffffffffa02f1cc6>] asmfs_file_read+0x66/0x160 [oracleasm]
[<ffffffff811816c5>] vfs_read+0xb5/0x1a0
[<ffffffff81181801>] sys_read+0x51/0x90
[<ffffffff810dc565>] ? __audit_syscall_exit+0x265/0x290
[<ffffffff8100b072>] system_call_fastpath+0x16/0x1b
Code: <48> 8b 92 80 00 00 00 4c 8b 20 8b 80 10 02 00 00 4c 8b 3a 48 8b 55
RIP [<ffffffffa0146027>] raid1_mergeable_bvec+0x27/0xf0 [raid1]
RSP <ffff8830596d3a08>
CR2: 0000000000000080
Resolution
- Please check if partition table for DM RAID is correctly configured. If it has the wrong configuration, it's failing with the below output before the crash.
md<number>: unknown partition table
This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.
Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.
