RHEL7: System crash at rpc_shutdown_client+4f

Solution Verified - Updated -

Issue

  • Kernel crashes with following logs:
[7989424.308518] general protection fault: 0000 [#1] SMP 
[7989424.313231] Modules linked in: iptable_filter tcp_diag udp_diag inet_diag unix_diag af_packet_diag netlink_diag nbd(OE) raid1 sg rpcsec_gss_krb5 nfsv4 dns_resolver nfs fscache nfit libnvdimm iosf_mbi crc32_pclmul ghash_clmulni_intel aesni_intel lrw gf128mul glue_helper ablk_helper cryptd ppdev parport_pc parport i2c_piix4 pcspkr binfmt_misc nfsd nfs_acl lockd grace auth_rpcgss ip_tables xfs libcrc32c nvme crct10dif_pclmul crct10dif_common ena nvme_core crc32c_intel serio_raw sunrpc dm_mirror dm_region_hash dm_log dm_mod
[7989424.351392] CPU: 15 PID: 31162 Comm: kworker/u32:0 Kdump: loaded Tainted: G           OE  ------------   3.10.0-1062.9.1.el7.x86_64 #1
[7989424.361202] Hardware name: Amazon EC2 c5.4xlarge/, BIOS 1.0 10/16/2017
[7989424.366375] Workqueue: nfsd4_callbacks nfsd4_run_cb_work [nfsd]
[7989424.371312] task: ffff962a19ae0000 ti: ffff96240e2e4000 task.ti: ffff96240e2e4000
[7989424.379472] RIP: 0010:[<ffffffffc00a80bf>]  [<ffffffffc00a80bf>] rpc_shutdown_client+0x4f/0x130 [sunrpc]
[7989424.388383] RSP: 0018:ffff96240e2e7c48  EFLAGS: 00010246
[7989424.392588] RAX: ffff96240e2e7c48 RBX: 74e5852b3ffb5a1a RCX: ffff96240e2e7fd8
[7989424.399785] RDX: 0000000000000000 RSI: e700000000000000 RDI: 74e5852b3ffb5a1a
[7989424.406726] RBP: ffff96240e2e7ca0 R08: ffff962416cbfce8 R09: a76f3af4234bfce0
[7989424.413791] R10: a76f3af4234bfce0 R11: 0000000000000000 R12: 74e5852b3ffb5a32
[7989424.420755] R13: ffff962416cbfca8 R14: ffff96240e2e7c60 R15: ffff962a19ae0000
[7989424.427731] FS:  0000000000000000(0000) GS:ffff962a2d5c0000(0000) knlGS:0000000000000000
[7989424.434981] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[7989424.439124] CR2: 00007fe87818c384 CR3: 00000007cd810000 CR4: 00000000007606e0
[7989424.446077] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[7989424.453008] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[7989424.459929] PKRU: 00000000
[7989424.463169] Call Trace:
[7989424.466306]  [<ffffffff8c4c3254>] ? __kernel_text_address+0x64/0x90
[7989424.470568]  [<ffffffff8c43081c>] ? show_trace_log_lvl+0x17c/0x330
[7989424.474814]  [<ffffffffc01a184e>] nfsd4_process_cb_update.isra.7+0x3e/0x1f0 [nfsd]
[7989424.481861]  [<ffffffff8c4e0008>] ? __enqueue_entity+0x78/0x80
[7989424.485996]  [<ffffffff8c4e651b>] ? put_prev_entity+0x8b/0x400
[7989424.490133]  [<ffffffff8cb8dd37>] ? ret_from_fork_nospec_begin+0x21/0x21
[7989424.494537]  [<ffffffff8c42b59e>] ? __switch_to+0xce/0x580
[7989424.498577]  [<ffffffff8cb805a2>] ? __schedule+0x402/0x840
[7989424.502610]  [<ffffffff8c4bb68e>] ? move_linked_works+0x5e/0x90
[7989424.506794]  [<ffffffffc01a1aa4>] nfsd4_run_cb_work+0xa4/0x110 [nfsd]
[7989424.511101]  [<ffffffff8c4be21f>] process_one_work+0x17f/0x440
[7989424.515277]  [<ffffffff8c4bf336>] worker_thread+0x126/0x3c0
[7989424.519337]  [<ffffffff8c4bf210>] ? manage_workers.isra.26+0x2a0/0x2a0
[7989424.523697]  [<ffffffff8c4c61f1>] kthread+0xd1/0xe0
[7989424.527587]  [<ffffffff8c4c6120>] ? insert_kthread_work+0x40/0x40
[7989424.531902]  [<ffffffff8cb8dd37>] ret_from_fork_nospec_begin+0x21/0x21
[7989424.536277]  [<ffffffff8c4c6120>] ? insert_kthread_work+0x40/0x40
[7989424.540502] Code: 45 d0 31 c0 e8 d3 8b ad cc f6 05 c8 b0 03 00 02 0f 85 be 00 00 00 48 8d 45 a8 4c 8d 63 18 65 4c 8b 3c 25 80 0e 01 00 4c 8d 70 18 <4c> 3b 63 18 74 0e 48 89 df e8 43 d5 ff ff 4c 3b 63 18 75 2d 48 
[7989424.557387] RIP  [<ffffffffc00a80bf>] rpc_shutdown_client+0x4f/0x130 [sunrpc]
[7989424.565602]  RSP <ffff96240e2e7c48>

Environment

  • Red Hat Enterprise Linux 7
  • NFSv4

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content