Migrating influxdb data to new setup

InfluxDB 2
,
1

Hello,

I’m having a lot of difficulty migrating data between machines. Both run docker-compose to handle a full MING stack, but I’m unable to get the data to transfer. I’ve tried query/write, import/export, installed the CLI on both, attempted to use Telegraf, but to no avail. I also don’t see the download CSV option in influxDB. I’m happy to retry any steps as it’s likely user-error.

I was able to create an annotated CSV file from the working database, but can’t get it to upload into the new database.

Any help would be greatly appreciated. More than happy to provide any screenshots, info, versions, etc if it helps.

image
image1417×689 126 KB

Thank you in advance for any guidance!

2

Update: I was able to successfully migrate data from one InfluxDB to another - I ultimately used the query command to export data to an annotated CSV file. I had to split it into smaller data samples as the past 30 days (32MB worth of data) was too much and would crash influxdb (2GB RAM on a VM). The command was:

./influx query --org “myOrgName” --token “myToken” --raw ‘from(bucket: “myBucket”) |> range(start: -30d) |> filter(fn: (r) => r._measurement == “oxygen-sensor”)’ > full_export.csv

In the command above, I replaced myOrgName, myToken, and myBucket to fit my setup. I also queried the past 30 days and most importantly filtered from the “oxygen-sensor” tag under _measurements. This important step reduced 30 days of data from 1.3GB to 32MB as it only contained measurement data that we were interested in.

Then, I logged into the web UI of InfluxDB > Load Data > Upload a CSV > Select bucket to be written to > select file for upload. Trying to upload the whole 32MB file wouldn’t work, but breaking it up into sections >10MB and separated by #group sections worked beautifully.

3

@bhaist

FWIW, I also set up a new InfluxDB machine a few months ago and moved all of my existing data to the new machine. I used the regular backup and restore commands and it worked perfectly. Super important step was this: Restore data in InfluxDB | InfluxDB OSS v2 Documentation

1 Like
4

Thank you! If I encounter this issue again, I’ll definitely try this method. I got a little lost between docker-compose and migrating specific data to newly named buckets.