OSS 2.6 CSV Import thru UI Errors

InfluxDB 2
1

the error message is:

Failed to upload the selected CSV: error in csv.from(): failed to read metadata: missing expected annotation datatype. consider using the mode: “raw” for csv that is not expected to have annotations.

The CSV file I’m uploading looks like this:
#datatype measurement,tag,dateTime:RFC3339,double,double,double,double,double,double,string,double,double,string,double,double,double,double,double
instrument,location,timestamp,temp_out,temp_hi,temp_low,hum_out,dew_pt,wind_speed,wind_dir,wind_run,wind_speed_hi,wind_dir_hi,wind_chill,heat_index,barometer,rain,rain_rate
Vantage Pro2,VistaDelSol,2007-01-01T00:10:00-07:00,14.3,14.8,14.3,88,11.4,2.0,NNW,0.33,4.0,NNW,11.5,14.2,30.366,0.00,0.00
Vantage Pro2,VistaDelSol,2007-01-01T00:20:00-07:00,14.0,14.3,14.0,88,11.1,1.0,NNW,0.17,3.0,NNW,14.0,13.9,30.369,0.00,0.00

My intended schema was 1 measurement, 1 tag, 1 timestamp and all the rest fields.
I’ve tried many different versions of #datatype, header and data all giving different errors. Read thru the docs and it isn’t very clear to someone who doesn’t know it before. I’m sure when it works it makes sense but not to me now. Sorry for the word wrap. Tried uploading the file but it won’t new users.

2

The only way I can get this to work is if I hack up my csv file to have only one field and field value per row in the file. This is not at all intuitive for someone with only flat file or RDBMS experience. I must be missing something. Any ideas?

#group,false,false,true,false,true,true,true
#datatype,string,long,dateTime:RFC3339,double,string,string,string
#default,result,,,,,,
,result,table,_time,_value,_field,_measurement,location
,,0,2007-01-01T00:10:00-07:00,14.3,temp_out,Vantage Pro2,VistaDelSol
,,1,2007-01-01T00:10:00-07:00,14.8,temp_hi,Vantage Pro2,VistaDelSol
,,2,2007-01-01T00:10:00-07:00,14.3,temp_low,Vantage Pro2,VistaDelSol
,,3,2007-01-01T00:10:00-07:00,88,hum_out,Vantage Pro2,VistaDelSol
,,4,2007-01-01T00:10:00-07:00,11.4,dew_pt,Vantage Pro2,VistaDelSol
,,5,2007-01-01T00:10:00-07:00,2.0,wind_speed,Vantage Pro2,VistaDelSol
,,6,2007-01-01T00:10:00-07:00,NNW,wind_dir,Vantage Pro2,VistaDelSol
,,7,2007-01-01T00:10:00-07:00,0.33,wind_run,Vantage Pro2,VistaDelSol
,,8,2007-01-01T00:10:00-07:00,4.0,wind_speed_hi,Vantage Pro2,VistaDelSol
,,9,2007-01-01T00:10:00-07:00,NNW,wind_dir_hi,Vantage Pro2,VistaDelSol
,,10,2007-01-01T00:10:00-07:00,11.5,wind_chill,Vantage Pro2,VistaDelSol
,,11,2007-01-01T00:10:00-07:00,14.2,heat_index,Vantage Pro2,VistaDelSol
,,12,2007-01-01T00:10:00-07:00,30.366,barometer,Vantage Pro2,VistaDelSol
,,13,2007-01-01T00:10:00-07:00,0.00,rain,Vantage Pro2,VistaDelSol
,,14,2007-01-01T00:10:00-07:00,0.00,rain_rate,Vantage Pro2,VistaDelSol
3

I have more encouraging results. I guess my problem all along with getting the correct annotated CSV format was that it just isn’t working as expected when uploading through the InFluxDB UI. I switched to using the CLI and it worked perfectly. So here’s what I did.

Here’s a sample of the annotated CSV file with one row of data that uploaded correctly.

#datatype measurement,tag,dateTime:RFC3339,double,double,double,double,double,double,string,double,double,string,double,double,double,double,double
instrument,location,timestamp,temp_out,temp_hi,temp_low,hum_out,dew_pt,wind_speed,wind_dir,wind_run,wind_speed_hi,wind_dir_hi,wind_chill,heat_index,barometer,rain,rain_rate
VantagePro2,VistaDelSol,2007-01-01T00:10:00-07:00,14.3,14.8,14.3,88,11.4,2.0,NNW,0.33,4.0,NNW,11.5,14.2,30.366,0.00,0.00

Here’s the CLI command and resluts when using the dryrun attribute. The dryrun attribute outputs to the terminal rather than actually to the bucket. You can see that it is properly creating the 1 measurement, 1 tag, 1 timestamp, and the rest are fields and field values.

PS C:\Users\dommerpw\Documents\InfluxDB> influx write dryrun -b weatherlink -f ./export2007annotated.csv

VantagePro2,location=VistaDelSol temp_out=14.3,temp_hi=14.8,temp_low=14.3,hum_out=88,dew_pt=11.4,wind_speed=2,wind_dir="NNW",wind_run=0.33,wind_speed_hi=4,wind_dir_hi="NNW",wind_chill=11.5,heat_index=14.2,barometer=30.366,rain=0,rain_rate=0 1167635400000000000

My case is solved. I hope this helps the person having a similar problem.