OpenShift Container Platform 4 - Node reporting NotReady state related to ResourceExhausted

Issue

• We are often reporting NotReady state for Nodes, when Tekton pipelines are running. When looking at the NotReady Nodes, the below Events are being reported.

  Warning  ContainerGCFailed  6m3s               kubelet  rpc error: code = ResourceExhausted desc = grpc: received message larger than max (16997306 vs. 16777216)
  Normal   NodeNotReady       3m49s              kubelet  Node worker-01.example.com status is now: NodeNotReady
  Warning  ContainerGCFailed  2s (x6 over 5m3s)  kubelet  rpc error: code = ResourceExhausted desc = grpc: received message larger than max (17002501 vs. 16777216)
  

• OpenShift - Node are entering NotReady state and are reporting rpc error: code = ResourceExhausted desc = grpc: received message larger than max (17166130 vs. 16777216).