kernel BUG at fs/jbd2/commit.c:319 or fs/jbd2/commit.c:353 due to assertion failure (journal->j_running_transaction != NULL) in journal_commit_transaction

Issue

• Server kernel crash with the following message:

kernel BUG at fs/jbd/commit.c:319!
invalid opcode: 0000 [#1] SMP 
last sysfs file: /sys/devices/pci0000:00/0000:00:1f.3/i2c-0/name
CPU 0 
Modules linked in: autofs4 ... jbd mbcache sd_mod crc_t10dif megaraid_sas pata_acpi ata_generic ata_piix dm_mod [last unloaded: scsi_wait_scan]

Pid: 943, comm: kjournald Not tainted 2.6.32-131.21.1.el6.x86_64 #1 System x3550 M3 -[7944A2G]-
RIP: 0010:[<ffffffffa00603d7>]  [<ffffffffa00603d7>] journal_commit_transaction+0xde7/0x1140 [jbd]
RSP: 0018:ffff88036db55d50  EFLAGS: 00010246
RAX: 0000000000000000 RBX: ffff88036ce44000 RCX: 0000000000007c92
RDX: ffff88036c0fd000 RSI: 0000000000000286 RDI: ffff88036ce44000
RBP: ffff88036db55e60 R08: 0000000000000000 R09: 0000000000000001
R10: 0000000000000003 R11: 0000000000000000 R12: 0000000000000000
R13: ffff88036ce44000 R14: ffff88036c2ad4c0 R15: ffff88036ce44098
FS:  0000000000000000(0000) GS:ffff880028200000(0000) knlGS:0000000000000000
CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: 0000000001f10aa8 CR3: 000000036ff89000 CR4: 00000000000006f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process kjournald (pid: 943, threadinfo ffff88036db54000, task ffff88036c2ad4c0)
Stack:
 0000000000000001 ffffffff8100bc8e ffff880300000000 ffff88036ce44000
<0> 000000073a8f0d30 ffff88036ce44168 ffff88036c0fd000 0000000000000000
<0> ffff880300000fdc 000004c100000000 0000000000000000 ffff88036ce44024
Call Trace:
 [<ffffffff8100bc8e>] ? apic_timer_interrupt+0xe/0x20
 [<ffffffff8107960c>] ? lock_timer_base+0x3c/0x70
 [<ffffffff8107a0bb>] ? try_to_del_timer_sync+0x7b/0xe0
 [<ffffffffa00630f8>] kjournald+0xe8/0x250 [jbd]
 [<ffffffff8108e120>] ? autoremove_wake_function+0x0/0x40
 [<ffffffffa0063010>] ? kjournald+0x0/0x250 [jbd]
 [<ffffffff8108ddb6>] kthread+0x96/0xa0
 [<ffffffff8100c1ca>] child_rip+0xa/0x20
 [<ffffffff8108dd20>] ? kthread+0x0/0xa0
 [<ffffffff8100c1c0>] ? child_rip+0x0/0x20
Code: 02 bf 4c 89 f7 e8 6a 45 00 00 f0 41 ff 4e 60 e9 ae f6 ff ff be fb ff ff ff 4c 89 ef e8 43 31 00 00 4d 8b 74 24 28 e9 5d f7 ff ff <0f> 0b eb fe be c1 1c 00 00 4c 89 f7 e8 58 49 14 e1 e9 5f ff ff 
RIP  [<ffffffffa00603d7>] journal_commit_transaction+0xde7/0x1140 [jbd]
 RSP <ffff88036db55d50>

• Server crashes with the following message:

kernel BUG at fs/jbd2/commit.c:353!
invalid opcode: 0000 [#1] SMP 
last sysfs file: /sys/devices/pci0000:00/0000:00:16.0/0000:0b:00.0/local_cpus
CPU 1 
Modules linked in: bluetooth rfkill ktap_45364(U) autofs4 sunrpc ipv6 vsock(U) ext3 jbd ppdev parport_pc parport vmware_balloon microcode vmxnet3 sg vmci(U) i2c_piix4 i2c_core shpchp ext4 mbcache jbd2 sd_mod crc_t10dif sr_mod cdrom vmw_pvscsi pata_acpi ata_generic ata_piix dm_mirror dm_region_hash dm_log dm_mod [last unloaded: speedstep_lib]

Pid: 1427, comm: jbd2/dm-4-8 Not tainted 2.6.32-220.25.1.el6.x86_64 #1 VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform
RIP: 0010:[<ffffffffa007a88c>]  [<ffffffffa007a88c>] jbd2_journal_commit_transaction+0x120c/0x14b0 [jbd2]
RSP: 0018:ffff880c1c005d30  EFLAGS: 00010246
RAX: 0000000000000008 RBX: ffff880c1c68f000 RCX: 0000000000000000
RDX: ffff880c18dbe000 RSI: 0000000000000286 RDI: ffff880c1c68f000
RBP: ffff880c1c005e60 R08: 0000000000000000 R09: 0000000000000001
R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
R13: ffff880c1c68f000 R14: ffff880c1c016080 R15: ffff880c1c68f098
FS:  0000000000000000(0000) GS:ffff880028240000(0000) knlGS:0000000000000000
CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: 000000384b6ac6d0 CR3: 0000000a27f0b000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process jbd2/dm-4-8 (pid: 1427, threadinfo ffff880c1c004000, task ffff880c1c016080)
Stack:
 ffff880c1c005d90 ffffffff810096f0 ffff880b3d713578 ffff8804a533fac8
<0> ffff880188f2c0c0 ffff880c1c68f39c 003c00ff2e31964d ffff880c1c68f3b8
<0> ffff880c16b4b000 0000000800000000 00000fdc00000000 ffff880188f2c120
Call Trace:
 [<ffffffff810096f0>] ? __switch_to+0xd0/0x320
 [<ffffffff8107c24c>] ? lock_timer_base+0x3c/0x70
 [<ffffffff8107ccdb>] ? try_to_del_timer_sync+0x7b/0xe0
 [<ffffffffa007f968>] kjournald2+0xb8/0x220 [jbd2]
 [<ffffffff81090d30>] ? autoremove_wake_function+0x0/0x40
 [<ffffffffa007f8b0>] ? kjournald2+0x0/0x220 [jbd2]
 [<ffffffff810909c6>] kthread+0x96/0xa0
 [<ffffffff8100c14a>] child_rip+0xa/0x20
 [<ffffffff81090930>] ? kthread+0x0/0xa0
 [<ffffffff8100c140>] ? child_rip+0x0/0x20
Code: e8 1a 54 00 00 e9 59 f9 ff ff 89 c6 4c 89 ef e8 0b 54 00 00 e9 fb f1 ff ff be 01 00 00 00 4c 89 ef e8 49 52 00 00 e9 3c ee ff ff <0f> 0b eb fe 0f 0b eb fe 0f 0b 66 2e 0f 1f 84 00 00 00 00 00 eb 
RIP  [<ffffffffa007a88c>] jbd2_journal_commit_transaction+0x120c/0x14b0 [jbd2]
 RSP <ffff880c1c005d30>