A cluster node was evicted from the cluster when a kernel panic occurred: "general protection fault: 0000 .... RIP [<ffffffff8154bd55>] _spin_lock_irq+0x15/0x40" on RHEL 6

Issue

A cluster node was evicted from the cluster when a kernel panic occurred:

general protection fault: 0000 [#1] SMP
last sysfs file: /sys/kernel/dlm/clvmd/event_done
CPU 2
Modules linked in: dlm configfs iptable_filter ip_tables oracleasm bonding ipv6 dm_round_robin dm_multipath ipmi_devintf power_meter acpi_ipmi ipmi_si ipmi_msghandler microcode iTCO_wdt iTCO_vendor_support serio_raw lpc_ich mfd_core hpilo hpwdt sg i7core_edac edac_core shpchp ext4 jbd2 mbcache sd_mod lpfc scsi_transport_fc scsi_tgt crc_t10dif be2net hpsa dm_mirror dm_region_hash dm_log dm_mod [last unloaded: configfs]

Pid: 105580, comm: clvmd Not tainted 2.6.32-642.4.2.el6.x86_64 #1 HP ProLiant BL460c G7
RIP: 0010:[<ffffffff8154bd55>]  [<ffffffff8154bd55>] _spin_lock_irq+0x15/0x40
RSP: 0018:ffff8817f1183ca8  EFLAGS: 00010083
RAX: 0000000000010000 RBX: 0000000000000000 RCX: 0000000000000020
RDX: 0000000000000000 RSI: 0000000000000020 RDI: ffff101828e71598
RBP: ffff8817f1183ca8 R08: ffffffff8160da00 R09: 0000000000000000
R10: 0000000000015280 R11: 0000000000000000 R12: ffff8817f5774d40
R13: ffffffff8160da00 R14: ffff8817bbf5a780 R15: 0000000000000000
FS:  00007fefc7c5d7a0(0000) GS:ffff880c36620000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f51ff6c8490 CR3: 00000017f1b7b000 CR4: 00000000000007e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process clvmd (pid: 105580, threadinfo ffff8817f1180000, task ffff8817f4aae040)
Stack:
 ffff8817f1183d48 ffffffff810a091d ffff101828e71598 ffff8817f1183cf8
 ffff8817f5774d48 0000000000000000 0000000000000001 ffff8817f4aae040
 ffffffff8106c500 dead000000100100 dead000000200200 0000000000000282
Call Trace:
 [<ffffffff810a091d>] __cancel_work_timer+0xad/0x1e0
 [<ffffffff8106c500>] ? default_wake_function+0x0/0x20
 [<ffffffff810a0a80>] cancel_work_sync+0x10/0x20
 [<ffffffffa04f55c4>] close_connection+0xe4/0x120 [dlm]
 [<ffffffffa04f5ef0>] ? free_conn+0x0/0x90 [dlm]
 [<ffffffffa04f5f15>] free_conn+0x25/0x90 [dlm]
 [<ffffffffa04f412a>] foreach_conn+0x3a/0x60 [dlm]
 [<ffffffffa04f4553>] dlm_lowcomms_stop+0x73/0x90 [dlm]
 [<ffffffffa04f1e4a>] threads_stop+0x1a/0x30 [dlm]
 [<ffffffffa04f1fc5>] dlm_release_lockspace+0x165/0x480 [dlm]
 [<ffffffffa04fae72>] device_write+0x2b2/0x720 [dlm]
 [<ffffffff811bc860>] ? mntput_no_expire+0x30/0x110
 [<ffffffff8123aa06>] ? security_file_permission+0x16/0x20
 [<ffffffff81199c28>] vfs_write+0xb8/0x1a0
 [<ffffffff8119b116>] ? fget_light_pos+0x16/0x50
 [<ffffffff8119a761>] sys_write+0x51/0xb0
 [<ffffffff810ee25e>] ? __audit_syscall_exit+0x25e/0x290
 [<ffffffff8100b0d2>] system_call_fastpath+0x16/0x1b
Code: c1 74 0e f3 90 0f b7 0f eb f5 83 3f 00 75 f4 eb df 48 89 d0 c9 c3 55 48 89 e5 0f 1f 44 00 00 fa 66 0f 1f 44 00 00 b8 00 00 01 00 <f0> 0f c1 07 0f b7 d0 c1 e8 10 39 c2 74 0e f3 90 0f b7 17 eb f5
RIP  [<ffffffff8154bd55>] _spin_lock_irq+0x15/0x40
RSP <ffff8817f1183ca8>