general protection fault in __kmalloc_node_track_caller+0xf3/0x270 in RHEL 7

Solution Verified - Updated -

Issue

  • Our system crashed with a general protection fault. The dmesg log from the vmcore contains the following:
[179099.936215] general protection fault: 0000 [#1] SMP 
[179099.936256] Modules linked in: iptable_nat nf_nat_ipv4 nf_nat fuse btrfs zlib_deflate raid6_pq xor msdos binfmt_misc vfat fat loop vhost_net macvtap macvlan ip6table_filter ip6_tables ebt_arp ebtable_nat ebtables rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd sunrpc fscache dm_service_time scsi_transport_iscsi softdog dm_multipath xt_physdev ipt_REJECT nf_conntrack_ipv4 nf_defrag_ipv4 xt_multiport xt_conntrack nf_conntrack iptable_filter ip_tables 8021q garp mrp tun bridge stp llc bonding ipmi_devintf dcdbas ext4 mbcache jbd2 kvm_amd kvm sp5100_tco crct10dif_pclmul crc32_pclmul ipmi_si crc32c_intel ipmi_msghandler shpchp ghash_clmulni_intel pcspkr aesni_intel lrw gf128mul amd64_edac_mod glue_helper ablk_helper edac_mce_amd cryptd edac_core serio_raw acpi_power_meter i2c_piix4 k10temp fam15h_power
[179099.936754]  xfs libcrc32c sd_mod sr_mod cdrom crc_t10dif usb_storage crct10dif_common mgag200 syscopyarea sysfillrect qla2xxx sysimgblt i2c_algo_bit drm_kms_helper ttm scsi_transport_fc ixgbe drm ahci scsi_tgt libahci mdio ptp i2c_core libata pps_core megaraid_sas dca bnx2 dm_mirror dm_region_hash dm_log dm_mod
[179099.936947] CPU: 4 PID: 26417 Comm: qemu-kvm Tainted: G        W   --------------   3.10.0-229.4.2.el7.x86_64 #1
[179099.936998] Hardware name: Dell Inc. PowerEdge R815/0W13NR, BIOS 3.2.2 09/15/2014
[179099.937037] task: ffff887fc71edb00 ti: ffff887fc4410000 task.ti: ffff887fc4410000
[179099.937076] RIP: 0010:[<ffffffff811ae353>]  [<ffffffff811ae353>] __kmalloc_node_track_caller+0xf3/0x270
[179099.937129] RSP: 0018:ffff887fc4413b28  EFLAGS: 00010246
[179099.937158] RAX: 0000000000000000 RBX: ffff881fb0ed0000 RCX: 000000000005b2a9
[179099.937196] RDX: 000000000005b2a8 RSI: 0000000000000000 RDI: 00000000000164a0
[179099.937232] RBP: ffff887fc4413b70 R08: ffff880fdfd164a0 R09: ffff880fdf807200
[179099.937269] R10: ffff880fdf807200 R11: 0000000000000000 R12: 00000000000106d0
[179099.937306] R13: 00000000000002c0 R14: 626d22202c303434 R15: 00000000ffffffff
[179099.937344] FS:  00007ff1d0f32a40(0000) GS:ffff880fdfd00000(0000) knlGS:0000000000000000
[179099.937385] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[179099.937415] CR2: 0000003773f55a42 CR3: 0000007faaade000 CR4: 00000000000407e0
[179099.937452] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[179099.937489] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[179099.937525] Stack:
[179099.937538]  ffff887fc71edb00 00000001c4413b90 ffff880fdf807200 ffffffff814ecced
[179099.937605]  ffff881fb0ed0000 ffff887fc4413bcf 00000000000004d0 00000000000002c0
[179099.937661]  00000000ffffffff ffff887fc4413bb0 ffffffff814ebfd1 ffffffff814eccbd
[179099.937716] Call Trace:
[179099.937738]  [<ffffffff814ecced>] ? __alloc_skb+0x8d/0x2d0
[179099.937772]  [<ffffffff814ebfd1>] __kmalloc_reserve.isra.27+0x31/0x90
[179099.937810]  [<ffffffff814eccbd>] ? __alloc_skb+0x5d/0x2d0
[179099.937844]  [<ffffffff814ecced>] __alloc_skb+0x8d/0x2d0
[179099.939203]  [<ffffffff814e6e28>] sock_alloc_send_pskb+0x1e8/0x380
[179099.940532]  [<ffffffff814e6fd5>] sock_alloc_send_skb+0x15/0x20
[179099.941849]  [<ffffffff815a10bf>] unix_stream_sendmsg+0x27f/0x420
[179099.943147]  [<ffffffff8126bd25>] ? sock_has_perm+0x75/0x90
[179099.944429]  [<ffffffff814e27a7>] sock_aio_write+0x157/0x180
[179099.945690]  [<ffffffff811c5e7d>] do_sync_write+0x8d/0xd0
[179099.946956]  [<ffffffff811c6715>] vfs_write+0x1b5/0x1e0
[179099.948209]  [<ffffffff814e4c35>] ? __sys_recvmsg+0x85/0x90
[179099.949474]  [<ffffffff811c7068>] SyS_write+0x58/0xb0
[179099.950747]  [<ffffffff81614169>] system_call_fastpath+0x16/0x1b
[179099.952027] Code: 00 49 63 41 18 66 66 66 66 90 4c 89 f0 48 83 c4 20 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 40 00 49 63 42 20 48 8d 4a 01 49 8b 3a <49> 8b 1c 06 4c 89 f0 65 48 0f c7 0f 0f 94 c0 84 c0 0f 84 5a ff 
[179099.954838] RIP  [<ffffffff811ae353>] __kmalloc_node_track_caller+0xf3/0x270
[179099.956230]  RSP <ffff887fc4413b28>

Environment

  • Red Hat Enterprise Linux 7
    • kernel-3.10.0-229.4.2.el7.x86_64
    • kernel-3.10.0-514.16.1.el7

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content