retentionPolicy not working as expected in Cluster Logging on OpenShift Container Platform 4 as indices are beyond the configured size limit

Solution Verified - Updated -

Issue

  • According to this definition of the IM jobs, the indices should be rolled over when older than 1 day, does contain over 122880000 documents or are bigger than 360gb in size. But when checking this, it does not appear to work as we have indices that are much bigger than 360gb.

    health status index           id                     pri rep docs.count docs.deleted store.size pri.store.size creation.date.string
    ..
    green  open   app-000523      RxOwkckATeeaqr7jRiDgwQ   5   4  352872619            0      1.7tb        362.5gb 2022-03-10T13:00:03.972Z
    green  open   app-000524      9P3ZOIhxRD2Kwz_gYG5YnA   5   4  355027232            0      1.7tb        361.6gb 2022-03-11T06:45:03.472Z
    green  open   app-000525      xU9E7gO3QUyV9Cgrk5-ZLw   5   4  373624561            0      1.7tb        357.5gb 2022-03-11T17:15:03.689Z
    

Environment

  • Red Hat OpenShift Container Platform (OCP) 4
  • Cluster Logging 5

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content