System hangs in hpsa error handling thread while resetting logical device
Issue
- System hangs in hpsa error handling thread while resetting logical device
[32080.070066] hpsa 0000:08:00.0: scsi 0:1:0:0: resetting logical Direct-Access HP LOGICAL VOLUME RAID-1(+0) SSDSmartPathCap+ En+ Exp=1 [32283.684498] INFO: task scsi_eh_0:676 blocked for more than 120 seconds. [32283.715109] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [32283.750553] scsi_eh_0 D ffff9a4afa068fd0 0 676 2 0x00000000 [32283.782879] Call Trace: [32283.794465] [] schedule+0x29/0x70 [32283.817377] [ ] hpsa_eh_device_reset_handler+0x4b5/0x7a0 [hpsa] crash> ps -m | grep UN | tail -n5 [1 11:14:59.538] [UN] PID: 4162 TASK: ffff9a4c26a35ee0 CPU: 23 COMMAND: "python" [1 11:15:07.220] [UN] PID: 676 TASK: ffff9a4afa068fd0 CPU: 41 COMMAND: "scsi_eh_0" [1 11:15:22.946] [UN] PID: 1658 TASK: ffff9a4afb08eeb0 CPU: 7 COMMAND: "xfsaild/dm-5" [1 11:15:38.260] [UN] PID: 60884 TASK: ffff9a7fe9ab6eb0 CPU: 19 COMMAND: "java" [1 11:15:38.292] [UN] PID: 61106 TASK: ffff9a4722bc0000 CPU: 5 COMMAND: "java" crash> bt ffff9a4afa068fd0 PID: 676 TASK: ffff9a4afa068fd0 CPU: 41 COMMAND: "scsi_eh_0" #0 [ffff9a4af8ec3c08] __schedule at ffffffffbbd128d4 #1 [ffff9a4af8ec3c90] schedule at ffffffffbbd12f49 #2 [ffff9a4af8ec3ca0] hpsa_eh_device_reset_handler at ffffffffc01fcfc5 [hpsa] #3 [ffff9a4af8ec3d90] scsi_try_bus_device_reset at ffffffffbba9ce6d #4 [ffff9a4af8ec3da8] scsi_eh_ready_devs at ffffffffbba9f06f #5 [ffff9a4af8ec3e30] scsi_error_handler at ffffffffbbaa0acc #6 [ffff9a4af8ec3ec8] kthread at ffffffffbb6bae31
Environment
- Red Hat Enterprise Linux 7
- Red Hat Enterprise Linux 6
- HPE Smart Array controller (hpsa driver)
- Exceptions:
- For systems that are already running a kernel version with the updated driver
- Check "Applications performing IO on HP RAID disks got hung" for additional possible causes for hangs.
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.