How to increase telegraf write batch size?

Telegraf
1

i set in
[agent]
metric_batch_size = 1000000
metric_buffer_limit = 10000000
but it writes 1000 metrics every flush interval:
Nov 22 13:12:13 deb11 telegraf[8526]: 2022-11-22T10:12:13Z D! [outputs.influxdb_v2] Wrote batch of 1000 metrics in 242.570137ms
Nov 22 13:12:13 deb11 telegraf[8526]: 2022-11-22T10:12:13Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000000 metrics

input is csv tail.

2

Tail plugin is also batching metrics, see its config documentation.

1 Like
3

I am having the same issue, input is kafka_consumer

4

@Suhas_H_E maybe open a new topic as you are using a completely different plugin. Anyway, you probably want to check the max_undelivered_messages option which is 1000 by default…

1 Like
5

That makes total sense let me try that