How parse/regex CSV data when uploading with telegraf/inputs.tail?

Telegraf
1

My .csv file looks like this:

Time,InnerTemp,OuterTemp,
2023-05-16 14:25:22,24.93℃,21.68℃,
2023-05-16 14:26:23,24.87℃,21.68℃,

I am uploading it with telegraf and the [[inputs.tail]] plugin:

[[inputs.tail]]  
  files = ["/*.csv"]
  data_format = "csv"
  csv_column_names = ["Time", "InnerTemp", "OuterTemp"]

This works fine. But my temperature values are transmitted as strings with the “℃” unit.
Obviously I could parse that further down the line, but is there any way to do this right here already?

2

No. The CSV parser does have no means to tamper with the input data other than splitting it apart. Use a processor for removing unwanted data and converting the fields.

3

Use processor.strings, TrimSuffix telegraf/README.md at release-1.26 · influxdata/telegraf · GitHub

4

Thank you for the tips!

This how I got it to work:

[[inputs.tail]]  
  files = ["/*.csv"]
  data_format = "csv"
  csv_column_names = ["Time", "InnerTemp", "OuterTemp"]

## Remove "℃" from the TEMPerX readings, so they can be treated as floats!
[[processors.strings]]
  order = 1
  [[processors.strings.trim_suffix]]
    field = "OuterTemp"
    suffix = "℃"
  [[processors.strings.trim_suffix]]
    field = "InnerTemp"
    suffix = "℃"

## Convert readings to proper floats
## Important that these two processor steps happen in order! 
[[processors.converter]]
  order = 2
  [processors.converter.fields]
    float  = ["OuterTemp","InnerTemp"]