Allow users to configure output message size for Kafka in RHOCP 4

Solution Verified - Updated -

Issue

  • When log forwarding logs to a Kafka server the log is rejected with the error:

    2020-11-17 12:40:01 +0000 [warn]: failed to flush the buffer. retry_time=27 next_retry_seconds=2020-11-17 12:45:11 +0000 chunk="5b44b9c6214a46a7c939c9244ef724b9" error_class=Kafka::MessageSizeTooLarge error="Kafka::MessageSizeTooLarge"
  • Not able to log forward logs to Kafka with error MessageSizeTooLarge

Environment

  • Red Hat OpenShift Container Platform (RHOCP)
    • 4
  • Red Hat OpenShift Logging (RHOL)
    • 5

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content