Telegraf agent warning - Outputs.influxdb did not complete within its flush interval?

Telegraf
,
1

Hi team,

I am getting this message in my telegraf logs every 10-15 seconds.

W! [agent] ["outputs.influxdb"] did not complete within its flush interval

Here is an extract of my configuration file. I’m reading from a Kinesis Data Stream with 5-6 shards and I am getting around 50 records/s each containing 400 measurements so ~20k events/s.
I’d love to hear any advice about how to choose these parameters.

[agent]
  interval = "1s"
  metric_batch_size = 5000
  metric_buffer_limit = 1000000
  collection_jitter = "0s"
  flush_interval = "5s"
  flush_jitter = "1s"
  precision = "s"

[[outputs.influxdb]]
  urls = ["influxdb-url"]
  flush_interval = "10s"
  flush_jitter = "5s"
  database = "telegraf"
  skip_database_creation = true
  timeout = "5s"

Thanks!

2

Hello @madamak,
I can really recommend watching this talk to learn more about telegraf:

It looks like you want to increase your flush interval. Also you might want to increase your batch size.