Disk is near out of space, but kubelet keeps reporting that it is fine.

Solution Verified - Updated -

Issue

  • Kubelet Pressure Conditions says that is everything fine on a system with 98% Disk Usage.
  • Results from df command below:

    $ df -h
    Filesystem      Size  Used Avail Use% Mounted on
    /dev/xvda2       20G   20G  588M  98% /
    devtmpfs         30G     0   30G   0% /dev
    tmpfs            30G     0   30G   0% /dev/shm
    tmpfs            30G   16M   30G   1% /run
    tmpfs            30G     0   30G   0% /sys/fs/cgroup
    /dev/xvdd       100G   79G   22G  79% /var/lib/docker
    /dev/xvdc        50G  3.5G   47G   7% /var/lib/origin/openshift.local.volumes
    tmpfs           6.0G     0  6.0G   0% /run/user/1000
    
  • Results from Kubelet Pressure Conditions

    • Conditions:

          Type           Status ...  ...  Reason                     Message
          DiskPressure   False            KubeletHasNoDiskPressure   kubelet has no disk pressure
          MemoryPressure False            KubeletHasSufficientMemory kubelet has sufficient memory available
          OutOfDisk      False            KubeletHasSufficientDisk   kubelet has sufficient disk space available
          Ready          True             KubeletReady               kubelet is posting ready status
      
  • If is that the case, kubelet should report that there is disk pressure, and stop getting new pods, and even start to get rid of some.

Environment

  • Red Hat OpenShift Container Platform (OCP) 3.9

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In