On a new RHEL 7.1 installation, the kernel crashed in the mpt2sas driver during boot
Issue
- upgrading from RHEL 7.0 to RHEL 7.1 resulted in a crash during boot in the mpt2sas driver, with the following trace-back
- system has no local disks and has not yet loaded the kexec kernel, so can't (easily) capture a vmcore
[ 47.413555] scsi host4: ioc0: LSISAS1064E B3, FwRev=01142300h, Ports=1, MaxQ=511, IRQ=16
[ 47.534127] mptsas: ioc0: attaching sata device: fw_channel 0, fw_id 1, phy 0, sas_addr 0x1221000000000000
[ 47.655260] scsi 4:0:0:0: Direct-Access ATA DENCSTE251M11-02 1.33 PQ: 0 ANSI: 5
[ 47.783416] mptsas: ioc0: attaching sata device: fw_channel 0, fw_id 2, phy 1, sas_addr 0x1221000001000000
[ 47.930663] scsi 4:0:1:0: Direct-Access ATA GB0500EAFJH HPGB PQ: 0 ANSI: 5
[ 48.033749] mptsas: ioc0: attaching sata device: fw_channel 0, fw_id 3, phy 2, sas_addr 0x1221000002000000
[ 48.149735] mptscsih: ioc0: attempting target reset! (sc=ffff8804012901c0)
[ 48.232035] scsi 4:0:2:0: CDB:
[ 48.269589] Inquiry: 12 00 00 00 24 00
[ 48.800880] mptscsih: ioc0: target reset: SUCCESS (sc=ffff8804012901c0)
[ 48.881043] BUG: unable to handle kernel NULL pointer dereference at 00000000000000a0
[ 48.882018] IP: [<ffffffff813f29a5>] scsi_eh_done+0x25/0xc0
[ 48.882018] PGD 0
[ 48.882018] Oops: 0000 [#1] SMP
[ 48.882018] Modules linked in: mgag200 syscopyarea sysfillrect sysimgblt i2c_algo_bit ata_generic drm_kms_helper pata_acpi tg3 ttm mptsas(+) ata_piix p
tp mptscsih pps_core drm libata mptbase i2c_core scsi_transport_sas dm_mirror dm_region_hash dm_log dm_mod
[ 48.882018] CPU: 5 PID: 335 Comm: systemd-udevd Not tainted 3.10.0-210.el7.x86_64 #1
[ 48.882018] Hardware name: HP SE1101 /SE1101 , BIOS O25 07/02/2008
[ 48.882018] task: ffff8804022aad80 ti: ffff880035658000 task.ti: ffff880035658000
[ 48.882018] RIP: 0010:[<ffffffff813f29a5>] [<ffffffff813f29a5>] scsi_eh_done+0x25/0xc0
[ 48.882018] RSP: 0018:ffff88003565b7e8 EFLAGS: 00010293
[ 48.882018] RAX: 0000000000000000 RBX: ffff8804012901c0 RCX: ffff880401182800
[ 48.882018] RDX: 0000000000000000 RSI: 0000000000000292 RDI: ffff8804012901c0
[ 48.882018] RBP: ffff88003565b7f8 R08: ffff880401182880 R09: 0000000000000000
[ 48.882018] R10: ffffea0010242a00 R11: ffffffff812d5fa8 R12: 0000000000000000
[ 48.882018] R13: ffff8804012901c0 R14: 0000000000000000 R15: ffff8804090a99b0
[ 48.882018] FS: 00007fcb7b9af880(0000) GS:ffff88041fd40000(0000) knlGS:0000000000000000
[ 48.882018] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 48.882018] CR2: 00000000000000a0 CR3: 000000003563f000 CR4: 00000000000007e0
[ 48.882018] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 48.882018] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 48.882018] Stack:
[ 48.882018] ffff8804012901c0 ffff88040901c000 ffff88003565b8a0 ffffffffa0188ff2
[ 48.882018] ffff88003565b840 ffffffff81090378 0000000000000246 ffff88040901c008
[ 48.882018] ffff8804096fb000 0000000000000282 ffff88040901cd30 ffff88040204f000
[ 48.882018] Call Trace:
[ 48.882018] [<ffffffffa0188ff2>] mptscsih_slave_destroy+0x192/0x560 [mptscsih]
[ 48.882018] [<ffffffff81090378>] ? __cancel_work_timer+0x88/0x120
[ 48.882018] [<ffffffff81090378>] ? __cancel_work_timer+0x88/0x120
[ 48.882018] [<ffffffff813fdc61>] __scsi_remove_device+0x81/0xd0
[ 48.882018] [<ffffffff813fa99d>] scsi_probe_and_add_lun+0x8ed/0xd30
[ 48.882018] [<ffffffff813deb1c>] ? __pm_runtime_resume+0x5c/0x80
[ 48.882018] [<ffffffff813fb77d>] __scsi_scan_target+0xad/0x260
[ 48.882018] [<ffffffff813fba20>] scsi_scan_target+0xf0/0x110
[ 48.882018] [<ffffffffa0038df6>] sas_rphy_add+0x106/0x170 [scsi_transport_sas]
[ 48.882018] [<ffffffffa00cfdb9>] mptsas_add_end_device+0x159/0x280 [mptsas]
[ 48.882018] [<ffffffffa00d60a2>] mptsas_scan_sas_topology+0x1a2/0x330 [mptsas]
[ 48.882018] [<ffffffff813ff6ba>] ? scsi_proc_host_add+0x6a/0xb0
[ 48.882018] [<ffffffffa00d65ce>] mptsas_probe+0x39e/0x5a0 [mptsas]
[ 48.882018] [<ffffffff81306f75>] local_pci_probe+0x45/0xa0
[ 48.882018] [<ffffffff813083e5>] ? pci_match_device+0xc5/0xd0
[ 48.882018] [<ffffffff81308529>] pci_device_probe+0xf9/0x150
[ 48.882018] [<ffffffff813d22b7>] driver_probe_device+0x87/0x390
[ 48.882018] [<ffffffff813d2693>] __driver_attach+0x93/0xa0
[ 48.882018] [<ffffffff813d2600>] ? __device_attach+0x40/0x40
[ 48.882018] [<ffffffff813d0043>] bus_for_each_dev+0x73/0xc0
[ 48.882018] [<ffffffff813d1d0e>] driver_attach+0x1e/0x20
[ 48.882018] [<ffffffff813d1860>] bus_add_driver+0x200/0x2d0
[ 48.882018] [<ffffffff813d2d14>] driver_register+0x64/0xf0
[ 48.882018] [<ffffffff81307fe5>] __pci_register_driver+0xa5/0xc0
[ 48.882018] [<ffffffffa00e0000>] ? 0xffffffffa00dffff
[ 48.882018] [<ffffffffa00e011e>] mptsas_init+0x11e/0x1000 [mptsas]
[ 48.882018] [<ffffffff810020b8>] do_one_initcall+0xb8/0x230
[ 48.882018] [<ffffffff810dcf1e>] load_module+0x131e/0x1b20
[ 48.882018] [<ffffffff812f6530>] ? ddebug_proc_write+0xf0/0xf0
[ 48.882018] [<ffffffff810d94a3>] ? copy_module_from_fd.isra.43+0x53/0x150
[ 48.882018] [<ffffffff810dd8d6>] SyS_finit_module+0xa6/0xd0
[ 48.882018] [<ffffffff81613929>] system_call_fastpath+0x16/0x1b
[ 48.882018] Code: ff ff ff 0f 1f 00 66 66 66 66 90 55 48 89 e5 53 48 89 fb 48 83 ec 08 8b 05 e9 f7 ad 00 83 e0 07 83 f8 03 77 1e 48 8b 03 48 8b 00 <48>
8b b8 a0 00 00 00 48 85 ff 74 05 e8 fa f9 ca ff 48 83 c4 08
[ 48.882018] RIP [<ffffffff813f29a5>] scsi_eh_done+0x25/0xc0
[ 48.882018] RSP <ffff88003565b7e8>
[ 48.882018] CR2: 00000000000000a0
[ 53.688371] ---[ end trace 5fedb72ae5806d3d ]---
Environment
- RHEL7.1 kernels 3.10-152.el7, and later (up until zstream errata, not yet released)
- previous kernels 3.10.0-151.el7 and earlier do not crash
- mptsas HBA LSISAS1064E B3, FwRev=01142300h
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.