RT kernel crashed during slab allocation with RIP kmem_cache_alloc+0x9a

Solution Verified - Updated -

Issue

  • PANIC: double fault: 0000 [#18] PREEMPT SMP
  • General fault protection during slab allocation RIP: kmem_cache_alloc+0x9a
  • Stack overflow in kworker and slab corruption observed with patterns as below :
[2598208.292359] Thread overran stack, or stack corrupted
[2598208.292360] Oops: 0000 [#17] PREEMPT SMP 
kmem: kmalloc-1024: slab: ffffea007fc47800 invalid freepointer: ff881ff11e1c0000
  • Backtrace of the panic task:
crash> bt 
PID: 31735  TASK: ffff881ff51c3360  CPU: 5   COMMAND: "kworker/u34:0"
 #0 [ffff881ff190f040] die at ffffffff8101ed9b
 #1 [ffff881ff190f070] do_general_protection at ffffffff81622e94
 #2 [ffff881ff190f0a0] general_protection at ffffffff81622552
    [exception RIP: kmem_cache_alloc+154]
    RIP: ffffffff811ace9a  RSP: ffff881ff190f158  RFLAGS: 00010286
    RAX: 0000000000000000  RBX: ffff88207fc5a5e0  RCX: 0000000d96db5605
    RDX: 0000000d96db5505  RSI: 0000000000011220  RDI: ff881ff11e1c0000
    RBP: ffff881ff190f1a8   R8: 000000000001a5e0   R9: ffffffff81155f45
    R10: 0000000000000000  R11: 0000000000000000  R12: ffff88103f803500
    R13: 0000000000011220  R14: ffff881ff190c000  R15: ffff881ff190c010
    ORIG_RAX: ffffffffffffffff  CS: 0010  SS: 0018
 #3 [ffff881ff190f1b0] mempool_alloc_slab at ffffffff81155f45
 #4 [ffff881ff190f1c0] mempool_alloc at ffffffff811560b9
 #5 [ffff881ff190f250] scsi_sg_alloc at ffffffff8140dad9
 #6 [ffff881ff190f260] __sg_alloc_table at ffffffff812e1bd2
 #7 [ffff881ff190f2d0] scsi_alloc_sgtable at ffffffff8140cc93
 #8 [ffff881ff190f300] scsi_init_sgtable at ffffffff8140cd0b
 #9 [ffff881ff190f320] scsi_init_io at ffffffff8140cdb3
#10 [ffff881ff190f380] sd_setup_read_write_cmnd at ffffffffa03119f8 [sd_mod]
#11 [ffff881ff190f3e0] sd_init_command at ffffffffa031457f [sd_mod]
#12 [ffff881ff190f3f0] scsi_setup_cmnd at ffffffff8140d02a
#13 [ffff881ff190f410] scsi_prep_fn at ffffffff8140d999
#14 [ffff881ff190f450] blk_peek_request at ffffffff812ac5b3
#15 [ffff881ff190f4b0] scsi_request_fn at ffffffff8140e9e8
#16 [ffff881ff190f550] __blk_run_queue at ffffffff812a9087
#17 [ffff881ff190f570] queue_unplugged at ffffffff812aba1e
#18 [ffff881ff190f5b0] blk_flush_plug_list at ffffffff812ac8e3
#19 [ffff881ff190f620] blk_queue_bio at ffffffff812adb12
#20 [ffff881ff190f670] generic_make_request at ffffffff812aa6ed
#21 [ffff881ff190f6b0] submit_bio at ffffffff812aa808
#22 [ffff881ff190f720] ext4_io_submit at ffffffffa0372649 [ext4]
#23 [ffff881ff190f740] ext4_bio_write_page at ffffffffa0372794 [ext4]
#24 [ffff881ff190f790] mpage_submit_page at ffffffffa0369608 [ext4]
#25 [ffff881ff190f7c0] mpage_map_and_submit_buffers at ffffffffa03699d4 [ext4]
#26 [ffff881ff190f8b0] mpage_map_and_submit_extent at ffffffffa036e81d [ext4]
#27 [ffff881ff190f910] ext4_writepages at ffffffffa0370ad2 [ext4]
#28 [ffff881ff190fab0] do_writepages at ffffffff8115f7b3
#29 [ffff881ff190fac0] __writeback_single_inode at ffffffff811eaf19
#30 [ffff881ff190fb10] writeback_sb_inodes at ffffffff811eb73b
#31 [ffff881ff190fbe0] __writeback_inodes_wb at ffffffff811eb8ae
#32 [ffff881ff190fc30] wb_writeback at ffffffff811ebbf3
#33 [ffff881ff190fcf0] wb_do_writeback at ffffffff811ebe44
#34 [ffff881ff190fd90] bdi_writeback_workfn at ffffffff811ebfd0
#35 [ffff881ff190fdf0] process_one_work at ffffffff8108c3f1
#36 [ffff881ff190fe40] worker_thread at ffffffff8108dc18
#37 [ffff881ff190fec0] kthread at ffffffff8109428e
#38 [ffff881ff190ff50] ret_from_fork at ffffffff81629ac8
crash> 

Environment

  • RHEL MRG - kernel 3.10.0-514.rt56.215.el6rt.x86_64

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content