New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

handle some Kafka producer exceptions to improve resilience #920

Open

FrankChen021 opened this issue Dec 3, 2024 · 0 comments

Labels

Component/Collector

Owner

FrankChen021 commented Dec 3, 2024

In case of Kafka partition leader failover, there might be lots of exceptions raised from collector causing message lost.

kafka-producer-network-thread | metrics-1 |   | org.apache.kafka.common.errors.NotLeaderOrFollowerException | For requests intended only for the leader, this error indicates that the broker is not the current leader. For requests intended for any replica, this error indicates that the broker is not a replica of the topic partition.

kafka-producer-network-thread | metrics-1 |   | org.apache.kafka.common.errors.TimeoutException | Expiring 11 record(s) for monitor_metrics-5:120000 ms has passed since batch creation

FrankChen021 added the Component/Collector label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment