Shard group not deleting and cardinality always increasing

InfluxDB 2
1

Hi, I am using influxdb2 oss with version 2.3, I have a bucket with RP 3days and shard group duration 1 hour, but I am observing that shard groups are never deleting and cardinality is always increasing. The retention policy deletion check is 30 mins, and all other configurations are default only.

Screenshot 2022-12-13 at 2.09.09 AM
Screenshot 2022-12-13 at 2.09.09 AM1744×172 106 KB

I can see shard groups from the day bucket was created, also disk size going up daily.
Any help will be great.
OS : linux
installed using: systemd , manual installation

2

Hey happy to see that I am not the only one .
My short term solution is to make a backup .
This destroy all the unnecessary chards and you reduce dramatically the size of the influx directory.
But this is not a solution and I really would like a real solution
Phil

3

Hi, I can also see in the logs
influxd-systemd-start.sh[24224]: ts=2022-12-14T16:55:09.952375Z lvl=error msg="Cannot create index file" log_id=0ekFFyVG000 service=storage-engine index=tsi tsi1_partition=1 op_name=tsi1_compact_log_file tsi1_log_file_id=1 error="open /grid/1/influxdata/data/9054e9141ae1c574/autogen/14/index/0/L1-00000001.tsi: permission denied"

and ls -l
ls -l /grid/1/influxdata/data/9054e9141ae1c574/autogen

drwxr-xr-x 3 influxdb influxdb 4096 Dec 14 14:40 11

drwxr-xr-x 3 influxdb influxdb 4096 Dec 14 15:40 12

drwxr-xr-x 3 influxdb influxdb 4096 Dec 14 17:40 14

drwxr-xr-x 3 influxdb influxdb 4096 Dec 14 18:40 15

drwxr-xr-x 3 influxdb influxdb 4096 Dec 14 19:40 16

drwxr-xr-x 3 influxdb influxdb 4096 Dec 14 20:40 17

drwxr-xr-x 3 influxdb influxdb 4096 Dec 14 21:40 18

drwxr-xr-x 3 influxdb influxdb 4096 Dec 14 18:40 19

drwxr-xr-x 3 influxdb influxdb 4096 Dec 14 19:40 20

drwxr-xr-x 3 influxdb influxdb 4096 Dec 14 20:40 21

drwxr-xr-x 3 influxdb influxdb 4096 Dec 14 21:40 22

drwxr-xr-x 3 influxdb influxdb 4096 Dec 14 22:26 23

drwxr-xr-x 3 influxdb influxdb 4096 Dec 14 22:29 24

drwxr-xr-x 3 influxdb influxdb 4096 Dec 14 12:40 9

not sure why this is happening. It is happening continuously. Can this be cause of some issue

4

Hi Phil,
Thanks for the short-term solution, have you also changed the engine-path for the DB? Also in metrics can you see retention count increasing?

5

Hi sorry but I can’t answer to those questions
Influxdb is in a dicker and I use the very last version .
I can give additional infos but please help me
Phil