Nodes transition to NotReady / processes stuck in D-state with Palo Alto Cortex XDR

Solution In Progress - Updated -

Issue

  • One or more worker nodes abruptly transition to a NotReady state.
  • Application pods on the affected nodes fail, remain in ContainerCreating, or report CNI errors.
  • The container runtime (crio) and kubelet stop logging or updating their status.
  • Multiple processes (such as crio, ovnkube, or bash) are stuck in uninterruptible sleep (D-state):
      ps -eo state,pid,cmd | grep "^D"
  • Stack traces of blocked processes show them waiting indefinitely on fanotify_get_response.
  • System journals or coredumpctl show the Cortex XDR pmd agent process crashing (e.g., SIGABRT, SIGSEGV, or kernel traps) shortly before the node hangs:
      coredumpctl list /opt/traps/bin/pmd

Environment

  • OpenShift Container Platform (OCP) 4.x
  • Red Hat Enterprise Linux CoreOS (RHCOS)
  • Palo Alto Networks Cortex XDR Agent (versions prior to 9.3.1, including 9.3.0.319)

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content