We are trying to load large amounts of data (terabytes) into InfluxDB from an existing third-party time-series database. We built a process that automatically generates files (with unique values and unique timestamps) compatible with the “influx –import” command, but it’s taking too many days running the “influx –import” command continuously to load our data. It was recommended that we try using influx_tools to speed-up our data loading.
I have some questions related to the following video posted on YouTube…
Video influx tools data generation tooling:
We are unable to locate the influx_tools binary or EXE? We’ve been testing with influxdb 1.7.4 on Windows OS. To be sure it’s not specific to Windows, we verified influx_tools does not ship with influxdb-1.7.4_linux_amd64 either. Strange because Stuart Carnie uploaded that video on Feb 15, 2019, so I figured the documentation is recent.
Using influx_tools, we are not certain that we can define “unique field values” and “unique timestamps” for each series? In the video examples, it appears to generate static/min&max/random values and evenly-spaced timestamps. There is some mention of specifying a source file (in the TOML format) with delimited values, but it wasn’t clear if the timestamps could be defined too. If this is possible, can you provide example TOML and delimited test files?