Fluentd was stuck processing

Solution Verified - Updated -

Issue

  • Some of our fluentd pods are reporting the following error:

    2018-08-29 13:01:31 -0400 [warn]: dead connection found: FluentD01.example.com, reconnecting...<br data-hasqtip="true">2018-08-29 13:01:36 -0400 [warn]: recovered connection to dead node: FluentD01.example.com<br data-hasqtip="true">2018-08-29 13:03:33 -0400 [warn]: temporarily failed to flush the buffer. next_retry=2018-08-29 13:08:30 -0400 error_class="Fluent::ElasticsearchErrorHandler::ElasticsearchError" error="The number of records submitted 7920 do not match the number returned 7919. Unable to process bulk response." plugin_id="object:3ffa4502aec0"
    

Environment

  • OpenShift Container Platform 3.9.30

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In