Telegraf inputs.file behavior

[tonic8]

Hello

this is, i think a “noob” question about inputs.file plugin/behavior:

• if the file is increasing, i understand the plugin will send the data as it come and send the difference between the last time it was executed
• file contain 2 lines at 10am, plugin parse it and send the data
• file had 1 more line, plugin at 10:10am will parse it and send only the new line
• etc…

but what happen if telegraf is stopped and restarted?

• does the plugin will reparse and only send NEW data or resend all data

is there a possibility for telegraf to parse a file and when finished to move it to another folder?
if so

• in case of success -> folder “success”
• in case of issues -> folder “failure”

REgards
and many thanks for your enlightments

[Anaisdg]

Hello!

• Yes it will send new data as it’s coming as long as you have from_beginning = false
• It isn’t currently possible to store the offsets when restarting. Telegraf tail input plugin reading position - #4 by daniel
• You could probably create the success/fail writing logic by using the execd processor plugin. For example you could also configure telegraf to send data to stdin. If the value is sent to stdin, write the metric to X, if there is a an error write metric to Y.
  telegraf/plugins/processors/execd at master · influxdata/telegraf · GitHub

[tonic8]

Hello @Anaisdg

many thanks for the clarifications, will check the processor execd topics.