Loss of old measurements

1

Hello,

I’m new to working with InfluxDB3. A few months ago, I set up a database with the following characteristics:

OS: Windows (Binary execution)

Version: InfluxDB 3 Core

Storage: Local Object Store with more or less 9350 snapshot files

I had no problems with the database. But recently, the oldest measures are disappearing over time without any retention policy defined. I’ve noticed that by deleting the most recent .info.json files from the snapshot folder, I can see older files that had disappeared, at the cost of no longer seeing the newer ones. I’ve been looking for information about this and haven’t found anything. Are there any limitations? Perhaps something is misconfigured?

Thanks in advance.

2

Most likely there is a retention policy there somehow that is causing this, can you check the same by using CLI or even via API

3

Hi Suyash,

First of all, thank you for your time. I have attached a screenshot of the command output you requested. According to this, I do not have any retention policies active.

To see the Parquet files that InfluxDB 3.0 is detecting, I am running: “SELECT * FROM system.parquet_files”. The result of this command consistently shows around 4,350 files, even though I have approximately 10,000 Parquet files in total.

Please let me know if you have any questions or need further details.

Thanks again!

image
image422×146 23.7 KB

4

Thanks @GuillePl, it looks like a bug to me, if you don’t mind filing a GitHub issue engineering team can investigate and reply there.

5

I will open the GitHub issue as requested so the team can track and investigate the bug.

Thank you suyash.

6

I got a reply. It’s a limitation, not a bug. I’ll leave their response here. Thanks again!

1 Like