Reading simple CSV doesn't produce any output

MrJ
Thu, 16 Nov 2023 17:58:01 +0000
Telegraf

Hi all, I’ve used Telegraf and InfluxDb for a couple of years now to collect Windows Performance counters, a new requirement has popped up which means that I need to collect and send data regarding data in backlog (could be queues, files in directories etc), so far so good, I have services that collect all this information and dump them to a CSV file. Now here comes my problem:

The CSV:s looks something like this:

name,count,protocol,timestamp
Internal API,44,ServiceBus,2023-11-16 18:51:11
Incoming,0,SMB,2023-11-16 18:51:11
External API,0,ServiceBus,2023-11-16 18:51:11
Flatfiles,2,SMB,2023-11-16 18:51:11

Telegraf has been configured as:

[global_tags]
env = "TEST"

[agent]
  interval = "10s"
  round_interval = true
  metric_buffer_limit = 1000
  flush_buffer_when_full = true
  collection_jitter = "0s"
  flush_interval = "5s"
  flush_jitter = "0s"
  debug = true
  quiet = false
  logfile = "C:\\AppLogs\\Telegraf\\Telegraf.log"
  hostname = ""

[[outputs.influxdb]]
  urls = ["https://influxdb.test.internal:15970/"]
  database = "testlog"
  timeout = "5s"
  username = "logger"
  password = "xxxxxxxxx"

[[outputs.file]]
  files = ["stdout", "C:\\temp\\metrics.out"]
  data_format = "json"

[[inputs.file]]
  files = ["C:\\QueueCounterData\\TelegrafDump-OP.csv"]
  data_format = "csv"
  csv_header_row_count = 1
  csv_tag_columns = ["name","protocol"]
  csv_tag_overwrite = true
  csv_timestamp_column = "timestamp"
  csv_measurement_column = "count"
  csv_timestamp_format = "2006-01-02 15:04:05"

If I run telegraf using

telegraf.exe -config .\telegraf.conf --test

It shows me the contents of the CSV, but if I run it without the test parameter it does run, but all I can see in the logs is:

2023-11-16T17:36:30Z D! [outputs.file] Buffer fullness: 0 / 1000 metrics
2023-11-16T17:36:30Z D! [outputs.influxdb] Buffer fullness: 0 / 1000 metrics

And nothing ever gets written to either the output file or to influx.
I’ve tried fiddling around a bit with the csv settings, but to no avail.

Anyone of you guys who knows where I’m going completely wrong here?

3 posts - 2 participants