NFS server panics after NFS daemons start

Solution Unverified - Updated -

Issue

  • Server comes up (with NFS running), but after a minute dumps core and crashes. This comes up on console:
Unable to handle kernel paging request at ffffffffffffffff RIP:
 [<ffffffff88d26e36>] :nfsd:nfsd_cache_lookup+0xd3/0x32b
PGD 203067 PUD 1042c8067 PMD 0
Oops: 0000 [1] SMP
last sysfs file: /class/fc_host/host6/active_fc4s
CPU 1
Modules linked in: mptctl mptbase ipmi_watchdog ipmi_devintf ipmi_si ipmi_msghandler nfsd exportfs auth_rpcgss nfs nfs_acl autofs4 hidp l2cap bluetooth lockd sunrpc bonding be2iscsi ib_iser rdma_cm ib_cm iw_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp bnx2i cnic ipv6 xfrm_nalgo crypto_api uio cxgb3i libcxgbi cxgb3 8021q libiscsi_tcp libiscsi2 scsi_transport_iscsi2 scsi_transport_iscsi ext3 jbd emcpvlumd(PU) emcpxcrypt(PU) emcpdm(PU) emcpgpx(PU) emcpmpx(PU) emcp(PU) dm_multipath scsi_dh video backlight sbs power_meter i2c_ec dell_wmi wmi button battery asus_acpi acpi_memhotplug ac parport_pc lp parport sr_mod k10temp cdrom hwmon tpm_tis tpm serio_raw i2c_piix4 amd64_edac_mod shpchp hpilo pcspkr edac_mc bnx2 i2c_core sg tpm_bios dm_raid45 dm_message dm_region_hash dm_mem_cache dm_snapshot dm_zero dm_mirror dm_log dm_mod usb_storage lpfc scsi_transport_fc sata_svw libata cciss(U) ext4 jbd2 crc16 uhci_hcd ohci_hcd ehci_hcd hpvsa(PU) sd_mod scsi_mod
Pid: 13886, comm: nfsd Tainted: P     --------------------    2.6.18-348.18.1.el5 #1
RIP: 0010:[<ffffffff88d26e36>]  [<ffffffff88d26e36>] :nfsd:nfsd_cache_lookup+0xd3/0x32b
RSP: 0018:ffff8100b7433e00  EFLAGS: 00010286
RAX: 0000000000000028 RBX: ffffffffffffffff RCX: 0000000000000000
RDX: ffff810127da6e28 RSI: 0000000000000002 RDI: ffffffff88d4a5d4
RBP: ffffffff88d4a7c8 R08: 0000006e66736404 R09: 0000000000000000
R10: 0000000000000080 R11: ffffffff88d4a7c8 R12: ffff8100b7bb4000
R13: 0000000062f9580a R14: 0000000000000007 R15: 0000000000000003
FS:  00002b44fd9216e0(0000) GS:ffff81012ff15940(0000) knlGS:00000000f15feb90
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: ffffffffffffffff CR3: 00000000c2a55000 CR4: 00000000000006e0
Process nfsd (pid: 13886, threadinfo ffff8100b7432000, task ffff8100b7b980c0)
Stack:  0000000000000400 ffff810127da6e28 00000006b7bb4000 ffff8100b7bb4000
 ffffffff88d4a7c8 ffffffff88d4a7c8 ffff8100b7b9e018 ffff8100b7b9e018
 0000000000000003 ffffffff88d1e143 ffff8100b7bb40a0 ffff8100b7bb4000
Call Trace:
 [<ffffffff88d1e143>] :nfsd:nfsd_dispatch+0x40/0x1d6
 [<ffffffff88c0874e>] :sunrpc:svc_process+0x3f8/0x6bf
 [<ffffffff80064624>] __down_read+0x12/0x92
 [<ffffffff88d1e5cb>] :nfsd:nfsd+0x0/0x2c9
 [<ffffffff88d1e770>] :nfsd:nfsd+0x1a5/0x2c9
 [<ffffffff8005dfc1>] child_rip+0xa/0x11
 [<ffffffff88d1e5cb>] :nfsd:nfsd+0x0/0x2c9
 [<ffffffff88d1e5cb>] :nfsd:nfsd+0x0/0x2c9
 [<ffffffff8005dfb7>] child_rip+0x0/0x11


Code: 48 8b 2b 0f 18 4d 00 80 7b 20 00 75 a2 eb e9 48 8b 1d c4 ed
RIP  [<ffffffff88d26e36>] :nfsd:nfsd_cache_lookup+0xd3/0x32b
 RSP <ffff8100b7433e00>
Memory for crash kernel (0x0 to 0x0) notwithin permissible range
Mounting proc filesystem
Mounting sysfs filesystem
Creating /dev
Creating initial device nodes
Loading ehci-hcd.ko module
Loading ohci-hcd.ko module
Loading uhci-hcd.ko module
Loading scsi_mod.ko module
Loading sd_mod.ko module
Loading cciss.ko module

Environment

  • Red Hat Enterprise Linux 5.9
  • NFS server with > 1024 nfsd threads

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content