Issue with Large Message Sizes in Kafka

get-help
1

I am encountering an error when attempting to push large data payloads to Kafka. Specifically, when sending a 3MB message, the following error is logged:

kumod::smtp_server: Error in SmtpServer: Message production error: MessageSizeTooLarge (Broker: Message size too large)
Despite my Kafka topic being allocated 1GB, this error occurs. Could you advise on how to increase the Kafka message size limit to accommodate larger messages?

3

can you try and add this to the producer ? :
["message.max.bytes"] = 10000000,

4

Ok . Can you please specify where this configuration add

5

it’s in kumo.kafka.build_producer, where you have your kafka servers declared. It should look like something like this:

    ["bootstrap.servers"] = <kafka_servers>,
    ["message.max.bytes"] = 10000000,
  }```
6

Its Working . Thanks for the update