I am trying to populate a v2 bucket with data as directly as possibly using a stream/file of line protocol values and the ‘influx’ CLI program. I found that I could easily ingest a 80MB file using v1.7, but performing the equivalent actions with v2, I start to get parsing errors not too deep into the file.
After inspection, the parsing errors start to occur at approx 8000 bytes into the stream/file. It is almost as if the WriteParserMaxBytes or MaxBatchSizeBytes in the http/api_handler package is set to non-zero values that is truncating the bulk write.
If there is someone out there who can provide some pointers (e.g. how to verify this, read/write these variables), or more directly - how to get the ‘influx’ application to write a large file (using the @filename.txt argument) - I would greatly appreciate it!