Fluentd was stuck processing

Solution Verified - Updated -

Issue

  • Some of our fluentd pods are reporting the following error:

    2018-08-29 13:01:31 -0400 [warn]: dead connection found: FluentD01.example.com, reconnecting...<br data-hasqtip="true">2018-08-29 13:01:36 -0400 [warn]: recovered connection to dead node: FluentD01.example.com<br data-hasqtip="true">2018-08-29 13:03:33 -0400 [warn]: temporarily failed to flush the buffer. next_retry=2018-08-29 13:08:30 -0400 error_class="Fluent::ElasticsearchErrorHandler::ElasticsearchError" error="The number of records submitted 7920 do not match the number returned 7919. Unable to process bulk response." plugin_id="object:3ffa4502aec0"
    

Environment

  • OpenShift Container Platform 3.9.30

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.

Current Customers and Partners

Log in for full access

Log In
Close

Welcome! Check out the Getting Started with Red Hat page for quick tours and guides for common tasks.