NetApp NFS4 server repeatedly responding to SETCLIENTID / SETCLIENTID_CONFIRM with NFS4_OK, but RENEW on same clientid gets NFS4ERR_EXPIRED

Issue

• The NFS4 lease time is set to 30 seconds, and an error injection test is done to simulate a network partition by blocking the NFS port with iptables for longer than the lease time.
• After this network partition which causes an NFS4 lease to expire, the NFS client sends a RENEW And gets a NFS4ERR_EXPIRED from the NFS server. The NFS client then tries to re-establish a clientid with SETCLIENTID / SETCLIENTID_CONFIRM and is able to do so. However even after this is done, the NFS client sends a RENEW with the clientid and the NFS server still responds with NFS4ERR_EXPIRED.

  1 2015-07-17 14:08:24.757128 10.242.53.11 -> 10.242.53.196 NFS 166 V4 Call RENEW CID: 0x63e7
  2 2015-07-17 14:08:24.757319 10.242.53.196 -> 10.242.53.11 NFS 114 V4 Reply (Call In 1) RENEW Status: NFS4ERR_EXPIRED
  3 2015-07-17 14:08:24.757340 10.242.53.11 -> 10.242.53.196 TCP 66 711 > 2049 [ACK] Seq=101 Ack=49 Win=126 Len=0 TSval=1177086 TSecr=72616587
  4 2015-07-17 14:08:24.757526 10.242.53.11 -> 10.242.53.196 NFS 166 V4 Call RENEW CID: 0x63e7
  5 2015-07-17 14:08:24.757672 10.242.53.196 -> 10.242.53.11 NFS 114 V4 Reply (Call In 4) RENEW Status: NFS4ERR_EXPIRED
  6 2015-07-17 14:08:24.757757 10.242.53.11 -> 10.242.53.196 NFS 250 V4 Call SETCLIENTID
  7 2015-07-17 14:08:24.758341 10.242.53.196 -> 10.242.53.11 NFS 130 V4 Reply (Call In 6) SETCLIENTID
  8 2015-07-17 14:08:24.758414 10.242.53.11 -> 10.242.53.196 NFS 174 V4 Call SETCLIENTID_CONFIRM
  9 2015-07-17 14:08:24.758567 10.242.53.196 -> 10.242.53.11 NFS 114 V4 Reply (Call In 8) SETCLIENTID_CONFIRM
 10 2015-07-17 14:08:24.798063 10.242.53.11 -> 10.242.53.196 TCP 66 711 > 2049 [ACK] Seq=493 Ack=209 Win=126 Len=0 TSval=1177127 TSecr=72616588
 11 2015-07-17 14:08:29.758175 10.242.53.11 -> 10.242.53.196 NFS 166 V4 Call RENEW CID: 0x63e7
 12 2015-07-17 14:08:29.758358 10.242.53.196 -> 10.242.53.11 NFS 114 V4 Reply (Call In 11) RENEW Status: NFS4ERR_EXPIRED
 13 2015-07-17 14:08:29.758379 10.242.53.11 -> 10.242.53.196 TCP 66 711 > 2049 [ACK] Seq=593 Ack=257 Win=126 Len=0 TSval=1182087 TSecr=72621588
 14 2015-07-17 14:08:29.758740 10.242.53.11 -> 10.242.53.196 NFS 166 V4 Call RENEW CID: 0x63e7
 15 2015-07-17 14:08:29.758976 10.242.53.196 -> 10.242.53.11 NFS 114 V4 Reply (Call In 14) RENEW Status: NFS4ERR_EXPIRED
 16 2015-07-17 14:08:29.759046 10.242.53.11 -> 10.242.53.196 NFS 250 V4 Call SETCLIENTID
 17 2015-07-17 14:08:29.759380 10.242.53.196 -> 10.242.53.11 NFS 130 V4 Reply (Call In 16) SETCLIENTID
 18 2015-07-17 14:08:29.759621 10.242.53.11 -> 10.242.53.196 NFS 174 V4 Call SETCLIENTID_CONFIRM
 19 2015-07-17 14:08:29.759793 10.242.53.196 -> 10.242.53.11 NFS 114 V4 Reply (Call In 18) SETCLIENTID_CONFIRM
 20 2015-07-17 14:08:29.799054 10.242.53.11 -> 10.242.53.196 TCP 66 711 > 2049 [ACK] Seq=985 Ack=417 Win=126 Len=0 TSval=1182128 TSecr=72621589
 21 2015-07-17 14:08:34.759072 10.242.53.11 -> 10.242.53.196 NFS 166 V4 Call RENEW CID: 0x63e7
 22 2015-07-17 14:08:34.759297 10.242.53.196 -> 10.242.53.11 NFS 114 V4 Reply (Call In 21) RENEW Status: NFS4ERR_EXPIRED