Fluentd - Bulk index queue is full, retrying in OpenShift

Solution Verified - Updated -

Issue

  • Getting ElasticsearchErrorHandler BulkIndexQueueFull messages

  • Fluentd won't push to Elasticsearch

    Aug 31 04:07:40 node.example.com dockerd-current[6060]: 2018-08-31 04:07:40 +0200 [warn]: temporarily failed to flush the buffer. next_retry=2018-08-31 04:07:19 +0200 error_    class="Fluent::ElasticsearchErrorHandler::BulkIndexQueueFull" error="Bulk index queue is full, retrying" plugin_id="object:c7c4dc"
    
  • Logs missing in Kibana

  • Buffer flush took longer time messages

    2019-09-25 01:45:26 -0700 [warn]: buffer flush took longer time than slow_flush_log_threshold: plugin_id="object:3ea119ad7d58" elapsed_time=22.682930512 slow_flush_log_threshold=20.0
    

Environment

  • Red Hat OpenShift Container Platform (RHOCP)
    • 3
    • 4

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content