Monitor output kafka on telegraf

i have some questions to ask you about monitoring telegraf. Right now i use outputs.kafka plugins for produce data that read from influxdb2 to a Kafka broker and i want some metrics such as batch size, linger.ms to monitor the producer performance how can i export this metrics from this telegraf instance. Thank you very much.

Hey @thititongumpun!

Sorry I’m not sure I fully understand what you are after… Do you want to get metrics about the Telegraf instance and send it to Kafka? If so, did you take a look at the internal input plugin? I believe we don’t export the batch-size as this is a static configuration parameter so it doesn’t make sense to send it over and over to a sink as it will never change for the running instance…

Does that help?

Thanks for answer.

What I meant is that I’m using the Kafka output, which means it’s essentially a Kafka producer. Is there any way to monitor the producer itself, for example metrics like client.id, batch size, or even JMX/Jolokia metrics from the producer side, and then collect them into Prometheus/Grafana?

Right now I can monitor the Telegraf instance itself, but I’d like to also monitor the Kafka producer.