I’m having problems taking a backup from our InfluxDB database. It’s running on a server and I’m trying to export some data using influxd restore command for offline analysis. Part of the data has quite a high sampling frequency and I just want a sample from a specific time interval.
The export seems to run fine, but the resulting files are quite small when taking the sampling frequency into consideration. When I added the data to my local InfluxDB instance using influxd restore only a few of the measurements were added. There should be 11 measurements but only 6 were added in the restore, suggesting that all measurements were not included in the backup.
Another issue is that the size of the data folder increased drastically when running the backup command. I had run it a few times before noticing this, but it seems like the size of C:\Users\aakb\.influxdb\data increased by the size of the orignal database every time. Originally the folder was around 30 GB now its over 200 GB!
Any suggestions for how to get all measurements included in the backup, and to remove the extra data that was created by running the backup command?
Result from backup command
C:\influxdb-1.8.3-1>influxd backup -database sensor_data -start "2021-03-17T11:55:00.000Z" -end "2021-03-17T13:20:00.000Z" -portable backup_2021_03_17
2021/03/18 10:43:43 backing up metastore to backup_2021_03_17\meta.00
2021/03/18 10:43:44 backing up db=sensor_data
2021/03/18 10:43:44 backing up db=sensor_data rp=autogen shard=58 to backup_2021_03_17\sensor_data.autogen.00058.00 with boundaries start=2021-03-17T11:55:00Z, end=2021-03-17T13:20:00Z
2021/03/18 10:43:44 backing up db=sensor_data rp=autogen shard=61 to backup_2021_03_17\sensor_data.autogen.00061.00 with boundaries start=2021-03-17T11:55:00Z, end=2021-03-17T13:20:00Z
2021/03/18 10:43:45 backing up db=sensor_data rp=autogen shard=69 to backup_2021_03_17\sensor_data.autogen.00069.00 with boundaries start=2021-03-17T11:55:00Z, end=2021-03-17T13:20:00Z
2021/03/18 10:43:45 backing up db=sensor_data rp=autogen shard=77 to backup_2021_03_17\sensor_data.autogen.00077.00 with boundaries start=2021-03-17T11:55:00Z, end=2021-03-17T13:20:00Z
2021/03/18 10:43:52 backup complete:
2021/03/18 10:43:52 backup_2021_03_17\20210318T104343Z.meta
2021/03/18 10:43:52 backup_2021_03_17\20210318T104343Z.s58.tar.gz
2021/03/18 10:43:52 backup_2021_03_17\20210318T104343Z.s61.tar.gz
2021/03/18 10:43:52 backup_2021_03_17\20210318T104343Z.s69.tar.gz
2021/03/18 10:43:52 backup_2021_03_17\20210318T104343Z.s77.tar.gz
2021/03/18 10:43:52 backup_2021_03_17\20210318T104343Z.manifest
Result from restore
C:\Users\fredrik\influxdb-1.8.3-1>influxd restore -db sensor_data -newdb new_sensor_data -portable backups\backup_2021_03_17
2021/03/18 13:00:39 Restoring shard 77 live from backup 20210318T104343Z.s77.tar.gz
2021/03/18 13:00:40 Restoring shard 58 live from backup 20210318T104343Z.s58.tar.gz
2021/03/18 13:00:40 Restoring shard 61 live from backup 20210318T104343Z.s61.tar.gz
2021/03/18 13:00:41 Restoring shard 69 live from backup 20210318T104343Z.s69.tar.gz
