Influxdb oss inspect export-lp

InfluxDB 2
,
1

We’re using
InfluxDB 2.0.8 (git: e91d41810f) build_date: 2021-08-13T18:22:30Z
and trying to migrate to influxcloud.

running this command here:
influxd inspect export-lp
–bucket-id [REDACTED]
–engine-path ./engine
–output-path ./backup/export.lp
–start 2021-10-01T00:00:00Z
–end 2022-12-31T23:59:59Z
–compress

and getting:
{“level”:“info”,“ts”:1680726037.1930377,“caller”:“inspect/export_lp.go:219”,“msg”:“exporting TSM files”,“tsm_dir”:“engine/data/[REDACTED]”,“file_count”:0}
{“level”:“info”,“ts”:1680726037.1931016,“caller”:“inspect/export_lp.go:315”,“msg”:“exporting WAL files”,“wal_dir”:“engine/wal/[REDACTED]”,“file_count”:0}
{“level”:“info”,“ts”:1680726037.193116,“caller”:“inspect/export_lp.go:204”,“msg”:“export complete”}

but the file export.lp is really small (23B) even thought we know there’s data there, is there anything missing? thanks

2

Hello @Martin23,
i’m confused is your data not existing with export.lp? Or are you looking for a way to verify whether or not it is?
To verify if the data is there you could try writing it to InfluxDB and querying it.
Thank you for your clarification

3

Well, I’m pretty sure the data is not in there. There’s only 23B and the original dataset is ~80GB. Do you know if there’s anything wrong with export-lp for that build?

Thanks,

M

4

Hello,

I believe I’ve encountered the same problem. Executing the same command as @Martin23 above on a Ubuntu machine with Influx OSS (configured as a systemd service):

$ influxd inspect export-lp --bucket-id [BUCKET_ID] --engine-path /home/data_storage/influxdb/engine --output-path ~/temp/export.lp --compress

yields the following output:

{“level”:“info”,“ts”:1712318566.676492,“caller”:“export_lp/export_lp.go:219”,“msg”:“exporting TSM files”,“tsm_dir”:“/home/data_storage/influxdb/engine/data/[BUCKET_ID]”,“file_count”:0}
{“level”:“info”,“ts”:1712318566.6767654,“caller”:“export_lp/export_lp.go:315”,“msg”:“exporting WAL files”,“wal_dir”:“/home/data_storage/influxdb/engine/wal/[BUCKET_ID]”,“file_count”:0}
{“level”:“info”,“ts”:1712318566.6768432,“caller”:“export_lp/export_lp.go:204”,“msg”:“export complete”}

i.e. there are no WAL or TSM files. Performing a query via the python client however shows that there is in fact time series data present in the database. It seems to be linked to a permissions issue; prepending the above command with “sudo -u influxdb” (i.e. executing the command as influxdb user) fixes the issue. It seems that the bucket directories in engine/data and engine/wal are only accessible for the influxdb user (not for the influxdb group!):

drwx------ 4 influxdb influxdb 4,0K Apr 5 12:40 [BUCKET_ID]

I guess I could also chmod and add group permissions, but this doesn’t seem like it was intended. Am I missing something?

1 Like
5

I had the same issue. The problem was file permissions. Re-run with sudo and the data will export.

1 Like
6

@Mike_Muller thanks so much for sharing your solution!!