I am running InfluxDB on AWS, persisting an EBS volume as the single instance comes and goes. I started with version 1.4.2 and inmem index. The instance was running for several months. When I rerolled the instance (I don’t think this was a graceful shutdown, which may have caused the problem?) and reattached the volume on a new one, all of the previous data was not queryable. It’s almost like Influx thought the start of time was when the new service started.
The data seems dormant in the file system. If I run an influx_inspect export, I can get all the data in line protocol. When I tried to reimport that, it brought the data back, but seemed to cause the filesystem to grow (so guessing it left these “shadow points” of missing data instead of overwriting it).
I have since upgraded to 1.6.1, and switched over to tsi1 index. During that instance reroll, the data issue occurred once again. I have tried to rebuild the indexes using influx_inspect buildtsi, but that didn’t seem to have any affect. On startup, it appears to be loading all the previous shards and takes 5-10 mins, but it seems it just doesn’t let it be queryable.
Does anyone have any pointers or ideas on how I can get Influx to recognize all the data?