Fluentd was stuck processing

Issue

• Some of our fluentd pods are reporting the following error:

  2018-08-29 13:01:31 -0400 [warn]: dead connection found: FluentD01.example.com, reconnecting...<br data-hasqtip="true">2018-08-29 13:01:36 -0400 [warn]: recovered connection to dead node: FluentD01.example.com<br data-hasqtip="true">2018-08-29 13:03:33 -0400 [warn]: temporarily failed to flush the buffer. next_retry=2018-08-29 13:08:30 -0400 error_class="Fluent::ElasticsearchErrorHandler::ElasticsearchError" error="The number of records submitted 7920 do not match the number returned 7919. Unable to process bulk response." plugin_id="object:3ffa4502aec0"