Raw/csv Export -> Import loose host tag

InfluxDB 2
1

dear, when using CLI to export raw data (annotated csv) and import to same machine or another one the tag host is missing. please see my details:

setup: tested on debian package 2.0.9 or docker 2.0.4

#EXPORT
$ docker container exec -i -t dck_influxdb influx query ‘from(bucket:“ds_test”) |> range(start:-1y) |> drop(columns: ["_start", “_stop”])’ --skip-verify --raw > ruth_ds_test_1y_filter.csv

#HEADER
$ head ruth_ds_test_1y_filter.csv
#group,false,false,false,false,true,true,true,true,true,true,true,true
#datatype,string,long,dateTime:RFC3339,double,string,string,string,string,string,string,string,string
#default,_result,
,result,table,_time,_value,DsCarrier,DsId,DsPin,DsValid,Machine,_field,_measurement,host
,0,2021-10-03T15:44:33.613Z,22.5625,labjack,1052176647976,14,true,mrazak,DsDecimal,dallas,ruth
,0,2021-10-03T15:45:44.305Z,22.5625,labjack,1052176647976,14,true,mrazak,DsDecimal,dallas,ruth
,0,2021-10-03T15:46:54.897Z,22.625,labjack,1052176647976,14,true,mrazak,DsDecimal,dallas,ruth
,0,2021-10-03T15:47:41.215Z,22.625,labjack,1052176647976,14,true,mrazak,DsDecimal,dallas,ruth
,0,2021-10-03T15:52:51.841Z,22.6875,labjack,1052176647976,14,true,mrazak,DsDecimal,dallas,ruth
,0,2021-10-03T15:58:02.434Z,22.625,labjack,1052176647976,14,true,mrazak,DsDecimal,dallas,ruth

#IMPORT
$ docker container exec -i -t dck_influxdb influx write -c default -t TOKEN --skip-verify --skipRowOnError --format csv -f /var/lib/influxdb2/ruth_ds_test_1y_filter.csv --bucket host_test

but after verification i cannot found my HOST tag

#VERIFICATION with group()
$ docker container exec -i -t dck_influxdb influx query ‘from(bucket:“host_test”) |> range(start:-1y) |> drop(columns: ["_start", “_stop”]) |> group() |> sort(columns: ["_time"], desc:true) |> limit(n: 5)’ --skip-verify --raw
#group,false,false,false,false,false,false,false,false,false,false,false
#datatype,string,long,dateTime:RFC3339,double,string,string,string,string,string,string,string
#default,_result,
,result,table,_time,_value,DsCarrier,DsId,DsPin,DsValid,Machine,_field,_measurement
,0,2021-10-25T15:20:09.439Z,20.875,labjack,841704586024,8,true,hrnecek_s_ledem,DsDecimal,dallas
,0,2021-10-25T15:20:08.568Z,20,labjack,236134354984,8,true,hrnecek_s_ledem,DsDecimal,dallas
,0,2021-10-25T15:20:06.301Z,19.625,labjack,1052176647976,14,true,mrazak,DsDecimal,dallas
,0,2021-10-25T15:20:05.431Z,19.625,labjack,910462155048,14,true,mrazak,DsDecimal,dallas
,0,2021-10-25T15:20:04.561Z,19.5,labjack,96928329000,14,true,mrazak,DsDecimal,dallas

#VERIFICATION no group()
conan@ruth:~/soft/docker$ docker container exec -i -t dck_influxdb influx query ‘from(bucket:“host_test”) |> range(start:-1y) |> drop(columns: ["_start", “_stop”]) |> sort(columns: ["_time"], desc:true) |> limit(n: 5)’ --skip-verify --raw
#group,false,false,false,false,true,true,true,true,true,true,true
#datatype,string,long,dateTime:RFC3339,double,string,string,string,string,string,string,string
#default,_result,
,result,table,_time,_value,DsCarrier,DsId,DsPin,DsValid,Machine,_field,_measurement
,0,2021-10-25T15:20:06.301Z,19.625,labjack,1052176647976,14,true,mrazak,DsDecimal,dallas
,0,2021-10-25T15:15:06.77Z,19.625,labjack,1052176647976,14,true,mrazak,DsDecimal,dallas
,0,2021-10-25T15:10:08.9Z,19.5,labjack,1052176647976,14,true,mrazak,DsDecimal,dallas
,0,2021-10-25T15:05:09.234Z,19.3125,labjack,1052176647976,14,true,mrazak,DsDecimal,dallas
,0,2021-10-25T15:00:09.541Z,19.5,labjack,1052176647976,14,true,mrazak,DsDecimal,dallas
,1,2021-10-25T15:20:08.568Z,20,labjack,236134354984,8,true,hrnecek_s_ledem,DsDecimal,dallas
,1,2021-10-25T15:15:08.787Z,19.875,labjack,236134354984,8,true,hrnecek_s_ledem,DsDecimal,dallas
,1,2021-10-25T15:10:04.117Z,19.6875,labjack,236134354984,8,true,hrnecek_s_ledem,DsDecimal,dallas
,1,2021-10-25T15:05:04.452Z,19.625,labjack,236134354984,8,true,hrnecek_s_ledem,DsDecimal,dallas
,1,2021-10-25T15:00:04.756Z,19.8125,labjack,236134354984,8,true,hrnecek_s_ledem,DsDecimal,dallas
,2,2021-10-05T18:20:04.307Z,20.5,labjack,841704586024,14,true,mrazak,DsDecimal,dallas
,3,2021-10-25T15:20:09.439Z,20.875,labjack,841704586024,8,true,hrnecek_s_ledem,DsDecimal,dallas
,3,2021-10-25T15:15:09.658Z,20.75,labjack,841704586024,8,true,hrnecek_s_ledem,DsDecimal,dallas
,3,2021-10-25T15:10:04.988Z,20.6875,labjack,841704586024,8,true,hrnecek_s_ledem,DsDecimal,dallas
,3,2021-10-25T15:05:05.325Z,20.5,labjack,841704586024,8,true,hrnecek_s_ledem,DsDecimal,dallas
,3,2021-10-25T15:00:05.626Z,20.4375,labjack,841704586024,8,true,hrnecek_s_ledem,DsDecimal,dallas
,4,2021-10-25T15:20:05.431Z,19.625,labjack,910462155048,14,true,mrazak,DsDecimal,dallas
,4,2021-10-25T15:15:05.852Z,19.625,labjack,910462155048,14,true,mrazak,DsDecimal,dallas
,4,2021-10-25T15:10:08.03Z,19.5,labjack,910462155048,14,true,mrazak,DsDecimal,dallas
,4,2021-10-25T15:05:08.364Z,19.3125,labjack,910462155048,14,true,mrazak,DsDecimal,dallas
,4,2021-10-25T15:00:08.669Z,19.4375,labjack,910462155048,14,true,mrazak,DsDecimal,dallas
,5,2021-10-25T15:20:04.561Z,19.5,labjack,96928329000,14,true,mrazak,DsDecimal,dallas
,5,2021-10-25T15:15:04.802Z,19.5,labjack,96928329000,14,true,mrazak,DsDecimal,dallas
,5,2021-10-25T15:10:07.159Z,19.375,labjack,96928329000,14,true,mrazak,DsDecimal,dallas
,5,2021-10-25T15:05:07.493Z,19.3125,labjack,96928329000,14,true,mrazak,DsDecimal,dallas
,5,2021-10-25T15:00:07.797Z,19.375,labjack,96928329000,14,true,mrazak,DsDecimal,dallas
,6,2021-10-03T10:57:32.498Z,20.8125,labjack,96928329000,8,true,hrnecek_s_ledem,DsDecimal,dallas

i was using this already 6 months ago, especialy when i need every 5minutes to copy data from influx 1 to influx 2. but probably i have missed this.

thank you, pavel

3

ooh, it took me a while to figure out

the CLI export append to every line ^M

#group,false,false,false,false,true,true,true,true,true,true,true,true^M
#datatype,string,long,dateTime:RFC3339,double,string,string,string,string,string,string,string,string^M
#default,_result,^M
,result,table,_time,_value,BatAddress,BatCarrier,BatId,BatValid,Machine,_field,_measurement,host^M
,0,2021-09-29T07:17:23.28Z,4.1188,0,labjack,037_3000mAh,true,single_cell_18650,BatDecimal,rpi,ruth^M
,0,2021-09-29T07:19:05.204Z,4.1193,0,labjack,037_3000mAh,true,single_cell_18650,BatDecimal,rpi,ruth^M
,0,2021-09-29T07:24:06.073Z,4.1214,0,labjack,037_3000mAh,true,single_cell_18650,BatDecimal,rpi,ruth^M
,0,2021-09-29T07:29:06.954Z,4.1204,0,labjack,037_3000mAh,true,single_cell_18650,BatDecimal,rpi,ruth^M

and that was the problem. was not visible via cat/less but find out via emacs

export was done via docker Version 2.0.4 (4e7a59b)

pavel

PS: time to be again using: $cat -v

4

@srbp thanks for sharing your solution!