Fluentd was stuck processing
Issue
-
Some of our fluentd pods are reporting the following error:
2018-08-29 13:01:31 -0400 [warn]: dead connection found: FluentD01.example.com, reconnecting...<br data-hasqtip="true">2018-08-29 13:01:36 -0400 [warn]: recovered connection to dead node: FluentD01.example.com<br data-hasqtip="true">2018-08-29 13:03:33 -0400 [warn]: temporarily failed to flush the buffer. next_retry=2018-08-29 13:08:30 -0400 error_class="Fluent::ElasticsearchErrorHandler::ElasticsearchError" error="The number of records submitted 7920 do not match the number returned 7919. Unable to process bulk response." plugin_id="object:3ffa4502aec0"
Environment
- OpenShift Container Platform 3.9.30
Subscriber exclusive content
A Red Hat subscription provides unlimited access to our knowledgebase of over 48,000 articles and solutions.