A cluster node was evicted from the cluster when a kernel panic occurred: "general protection fault: 0000 .... RIP [<ffffffff8154bd55>] _spin_lock_irq+0x15/0x40" on RHEL 6

Solution In Progress - Updated -

Issue

A cluster node was evicted from the cluster when a kernel panic occurred:

general protection fault: 0000 [#1] SMP
last sysfs file: /sys/kernel/dlm/clvmd/event_done
CPU 2
Modules linked in: dlm configfs iptable_filter ip_tables oracleasm bonding ipv6 dm_round_robin dm_multipath ipmi_devintf power_meter acpi_ipmi ipmi_si ipmi_msghandler microcode iTCO_wdt iTCO_vendor_support serio_raw lpc_ich mfd_core hpilo hpwdt sg i7core_edac edac_core shpchp ext4 jbd2 mbcache sd_mod lpfc scsi_transport_fc scsi_tgt crc_t10dif be2net hpsa dm_mirror dm_region_hash dm_log dm_mod [last unloaded: configfs]

Pid: 105580, comm: clvmd Not tainted 2.6.32-642.4.2.el6.x86_64 #1 HP ProLiant BL460c G7
RIP: 0010:[<ffffffff8154bd55>]  [<ffffffff8154bd55>] _spin_lock_irq+0x15/0x40
RSP: 0018:ffff8817f1183ca8  EFLAGS: 00010083
RAX: 0000000000010000 RBX: 0000000000000000 RCX: 0000000000000020
RDX: 0000000000000000 RSI: 0000000000000020 RDI: ffff101828e71598
RBP: ffff8817f1183ca8 R08: ffffffff8160da00 R09: 0000000000000000
R10: 0000000000015280 R11: 0000000000000000 R12: ffff8817f5774d40
R13: ffffffff8160da00 R14: ffff8817bbf5a780 R15: 0000000000000000
FS:  00007fefc7c5d7a0(0000) GS:ffff880c36620000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f51ff6c8490 CR3: 00000017f1b7b000 CR4: 00000000000007e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process clvmd (pid: 105580, threadinfo ffff8817f1180000, task ffff8817f4aae040)
Stack:
 ffff8817f1183d48 ffffffff810a091d ffff101828e71598 ffff8817f1183cf8
 ffff8817f5774d48 0000000000000000 0000000000000001 ffff8817f4aae040
 ffffffff8106c500 dead000000100100 dead000000200200 0000000000000282
Call Trace:
 [<ffffffff810a091d>] __cancel_work_timer+0xad/0x1e0
 [<ffffffff8106c500>] ? default_wake_function+0x0/0x20
 [<ffffffff810a0a80>] cancel_work_sync+0x10/0x20
 [<ffffffffa04f55c4>] close_connection+0xe4/0x120 [dlm]
 [<ffffffffa04f5ef0>] ? free_conn+0x0/0x90 [dlm]
 [<ffffffffa04f5f15>] free_conn+0x25/0x90 [dlm]
 [<ffffffffa04f412a>] foreach_conn+0x3a/0x60 [dlm]
 [<ffffffffa04f4553>] dlm_lowcomms_stop+0x73/0x90 [dlm]
 [<ffffffffa04f1e4a>] threads_stop+0x1a/0x30 [dlm]
 [<ffffffffa04f1fc5>] dlm_release_lockspace+0x165/0x480 [dlm]
 [<ffffffffa04fae72>] device_write+0x2b2/0x720 [dlm]
 [<ffffffff811bc860>] ? mntput_no_expire+0x30/0x110
 [<ffffffff8123aa06>] ? security_file_permission+0x16/0x20
 [<ffffffff81199c28>] vfs_write+0xb8/0x1a0
 [<ffffffff8119b116>] ? fget_light_pos+0x16/0x50
 [<ffffffff8119a761>] sys_write+0x51/0xb0
 [<ffffffff810ee25e>] ? __audit_syscall_exit+0x25e/0x290
 [<ffffffff8100b0d2>] system_call_fastpath+0x16/0x1b
Code: c1 74 0e f3 90 0f b7 0f eb f5 83 3f 00 75 f4 eb df 48 89 d0 c9 c3 55 48 89 e5 0f 1f 44 00 00 fa 66 0f 1f 44 00 00 b8 00 00 01 00 <f0> 0f c1 07 0f b7 d0 c1 e8 10 39 c2 74 0e f3 90 0f b7 17 eb f5
RIP  [<ffffffff8154bd55>] _spin_lock_irq+0x15/0x40
RSP <ffff8817f1183ca8>

Environment

  • Red Hat Enterprise Linux Server 6 (with the High Availability Add Ons)

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In
Close

Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.