I am using telegraf to import csv file in influxdb. For that I am using the plugin “file”. I have just simple questions:
- Telegraf read again csv already processed in a previous step or it reads again all matching csv each time?
- Is there a way to delete file when processed?
The file input plugin reads again each interval, but look at the tail plugin if you want only to read new lines.
There isn’t a way to delete the file, what I think we want a new plugin that provides filesystem based queuing.
Thank you for your reply. In my case I have around ten new files coming each minutes. But I do not want to remove the folder each time. If a file is processed 1 minutes before, is it again completely processed? Is there an impact on the cost computation if there is too many files?