Data lost from InfluxDB databases


#1

Hi,

I now have confirmation that InfluxDB has lost data.

A user contacted us to say he was looking at his charts last week and noticed there was no data showing for March, April or May this year (see attached). The chart he is looking is generated from aggregated data and I have been aware for a couple of weeks that there is a problem with aggregated data in this system, specifically for the period March, April and May. I was planning to rebuild the relevant database from the raw measurements, and assumed that this was just another example of that problem.

(In our system raw measurements get loaded into one database and then aggregated into 5- and 30-minute time intervals, into a separate database for each.)

The chart in the attached screenshot was generated on June 7 (we only received notice today, via a third party).
Investigating this problem today (June 13) the same chart shows NO data for January and February even though it is in the screen shot from last week.

Checking the raw (un-aggregated) and aggregated measurement data for this user I see no measurements prior to April 10 in the ‘raw’ database and nothing prior to May 31 in the two ‘aggregated’ databases. Yet we know for a fact that this user should have data going back to December last year.

Thinking this might be a case of in-memory index problems, I have done a clean shutdown of our application followed by a clean shutdown of Influx and then rebooted the server, but this did not bring any measurement data back.

I have now run influx_inspect to dump the ‘raw’ measurement database for January and there are NO entries for this customer in the dump. (The dump is 17G in size and contains lots of other data.)

How can we diagnose this further to work out what is going on?

Thanks,
Jeremy Begg


#2

I think more information on your configuration would be necessary to help diagnose, namely:

  1. What is the duration configuration for your DBs?
  2. Are you using CQ’s? If so, what is the configuration you have there?
  3. Which version of influxdb are you running?

#3

Here’s some more information about our setup.

We are running Influx 1.2.2 on Ubuntu Linux 16.04 LTS.

All three databases are set up with the default retention policy ‘autogen’, i.e. “infinite” retention.
The ‘raw’ measurements database, called “solarmon”, has the default 7-day shard duration.
The ‘aggregated’ measurement databases, called “solarmon_5min” and “solarmon_30min”, have 90-day shard duration.

We use both Continuous Queries and manual SELECT .. INTO queries to populate the “solarmon_5min” and “solarmon_30min” databases. The CQs are:

> show continuous queries
name: _internal
name query
---- -----


name: solarmon
name       query
----       -----
make_5min  CREATE CONTINUOUS QUERY make_5min ON solarmon RESAMPLE EVERY 10m BEGIN SELECT mean(*) AS avg, max(*), min(*) INTO solarmon_5min.autogen.:MEASUREMENT FROM solarmon.autogen./.*/ GROUP BY time(5m), * END
make_30min CREATE CONTINUOUS QUERY make_30min ON solarmon RESAMPLE EVERY 1h BEGIN SELECT mean(*) AS avg, max(*), min(*) INTO solarmon_30min.autogen.:MEASUREMENT FROM solarmon.autogen./.*/ GROUP BY time(30m), * END


name: solarmon_5min
name query
---- -----


name: solarmon_30min
name query
---- -----

And the manual SELECT .. INTO queries do almost the same thing, but with explicit measurement/tag values and time ranges.

My suspicion, based on watching data mysteriously disappearing from the aggregated databases and now from the raw database too, is that InfluxDB (TSM) is prone to losing data when applying updates over a wide time range. For example, back-filling the aggregated database for a series seems to randomly cause other series’ data to disappear. And now, with the raw measurement data, I know that several months’ worth of measurements were copied from one series to another and then the original series’ data deleted using DELETE FROM ... and the “lost” data would have been in the same shards.

Thanks,
Jeremy Begg


#4

Has the field type of your series changed between shards? If it changes, it can appear that the data is not there, but it’s just not being queried. For example, see https://github.com/influxdata/influxdb/issues/8422.

Can you attach the output of show shards as well as run show field keys?


#5

Hi Jason,
The fields are all floating-point numbers except for one which is an integer, and they are always numeric. (During initial testing on another system I have seen what happens when the type changes; typically the measurement is rejected by the HTTP service.)

The output of the commands will appear in successive replies.
(The web interface won’t let me include them in a single posting.)

Thanks
Jeremy Begg


#6
Connected to http://localhost:8086 version 1.2.2
InfluxDB shell version: 1.2.2
> show shards
name: _internal
id  database  retention_policy shard_group start_time           end_time             expiry_time          owners
--  --------  ---------------- ----------- ----------           --------             -----------          ------
635 _internal monitor          635         2017-06-06T00:00:00Z 2017-06-07T00:00:00Z 2017-06-14T00:00:00Z 
636 _internal monitor          636         2017-06-07T00:00:00Z 2017-06-08T00:00:00Z 2017-06-15T00:00:00Z 
637 _internal monitor          637         2017-06-08T00:00:00Z 2017-06-09T00:00:00Z 2017-06-16T00:00:00Z 
638 _internal monitor          638         2017-06-09T00:00:00Z 2017-06-10T00:00:00Z 2017-06-17T00:00:00Z 
639 _internal monitor          639         2017-06-10T00:00:00Z 2017-06-11T00:00:00Z 2017-06-18T00:00:00Z 
640 _internal monitor          640         2017-06-11T00:00:00Z 2017-06-12T00:00:00Z 2017-06-19T00:00:00Z 
641 _internal monitor          641         2017-06-12T00:00:00Z 2017-06-13T00:00:00Z 2017-06-20T00:00:00Z 
643 _internal monitor          643         2017-06-13T00:00:00Z 2017-06-14T00:00:00Z 2017-06-21T00:00:00Z 
649 _internal monitor          649         2017-06-14T00:00:00Z 2017-06-15T00:00:00Z 2017-06-22T00:00:00Z 


name: solarmon
id  database retention_policy shard_group start_time           end_time             expiry_time          owners
--  -------- ---------------- ----------- ----------           --------             -----------          ------
613 solarmon autogen          613         2011-09-12T00:00:00Z 2011-09-19T00:00:00Z 2011-09-19T00:00:00Z 
644 solarmon autogen          644         2012-12-31T00:00:00Z 2013-01-07T00:00:00Z 2013-01-07T00:00:00Z 
647 solarmon autogen          647         2013-03-11T00:00:00Z 2013-03-18T00:00:00Z 2013-03-18T00:00:00Z 
648 solarmon autogen          648         2013-03-18T00:00:00Z 2013-03-25T00:00:00Z 2013-03-25T00:00:00Z 
349 solarmon autogen          349         2013-04-29T00:00:00Z 2013-05-06T00:00:00Z 2013-05-06T00:00:00Z 
350 solarmon autogen          350         2013-05-06T00:00:00Z 2013-05-13T00:00:00Z 2013-05-13T00:00:00Z 
351 solarmon autogen          351         2013-05-13T00:00:00Z 2013-05-20T00:00:00Z 2013-05-20T00:00:00Z 
352 solarmon autogen          352         2013-05-20T00:00:00Z 2013-05-27T00:00:00Z 2013-05-27T00:00:00Z 
353 solarmon autogen          353         2013-05-27T00:00:00Z 2013-06-03T00:00:00Z 2013-06-03T00:00:00Z 
354 solarmon autogen          354         2013-06-03T00:00:00Z 2013-06-10T00:00:00Z 2013-06-10T00:00:00Z 
355 solarmon autogen          355         2013-06-10T00:00:00Z 2013-06-17T00:00:00Z 2013-06-17T00:00:00Z 
356 solarmon autogen          356         2013-06-17T00:00:00Z 2013-06-24T00:00:00Z 2013-06-24T00:00:00Z 
357 solarmon autogen          357         2013-06-24T00:00:00Z 2013-07-01T00:00:00Z 2013-07-01T00:00:00Z 
363 solarmon autogen          363         2013-07-01T00:00:00Z 2013-07-08T00:00:00Z 2013-07-08T00:00:00Z 
364 solarmon autogen          364         2013-07-08T00:00:00Z 2013-07-15T00:00:00Z 2013-07-15T00:00:00Z 
365 solarmon autogen          365         2013-07-15T00:00:00Z 2013-07-22T00:00:00Z 2013-07-22T00:00:00Z 
366 solarmon autogen          366         2013-07-22T00:00:00Z 2013-07-29T00:00:00Z 2013-07-29T00:00:00Z 
367 solarmon autogen          367         2013-07-29T00:00:00Z 2013-08-05T00:00:00Z 2013-08-05T00:00:00Z 
362 solarmon autogen          362         2013-08-05T00:00:00Z 2013-08-12T00:00:00Z 2013-08-12T00:00:00Z 
368 solarmon autogen          368         2013-08-12T00:00:00Z 2013-08-19T00:00:00Z 2013-08-19T00:00:00Z 
373 solarmon autogen          373         2013-08-19T00:00:00Z 2013-08-26T00:00:00Z 2013-08-26T00:00:00Z 
374 solarmon autogen          374         2013-08-26T00:00:00Z 2013-09-02T00:00:00Z 2013-09-02T00:00:00Z 
375 solarmon autogen          375         2013-09-02T00:00:00Z 2013-09-09T00:00:00Z 2013-09-09T00:00:00Z 
376 solarmon autogen          376         2013-09-09T00:00:00Z 2013-09-16T00:00:00Z 2013-09-16T00:00:00Z 
377 solarmon autogen          377         2013-09-16T00:00:00Z 2013-09-23T00:00:00Z 2013-09-23T00:00:00Z 
372 solarmon autogen          372         2013-09-23T00:00:00Z 2013-09-30T00:00:00Z 2013-09-30T00:00:00Z 
371 solarmon autogen          371         2013-09-30T00:00:00Z 2013-10-07T00:00:00Z 2013-10-07T00:00:00Z 
369 solarmon autogen          369         2013-10-07T00:00:00Z 2013-10-14T00:00:00Z 2013-10-14T00:00:00Z 
370 solarmon autogen          370         2013-10-14T00:00:00Z 2013-10-21T00:00:00Z 2013-10-21T00:00:00Z 
380 solarmon autogen          380         2013-10-21T00:00:00Z 2013-10-28T00:00:00Z 2013-10-28T00:00:00Z 
381 solarmon autogen          381         2013-10-28T00:00:00Z 2013-11-04T00:00:00Z 2013-11-04T00:00:00Z 
382 solarmon autogen          382         2013-11-04T00:00:00Z 2013-11-11T00:00:00Z 2013-11-11T00:00:00Z 
383 solarmon autogen          383         2013-11-11T00:00:00Z 2013-11-18T00:00:00Z 2013-11-18T00:00:00Z 
384 solarmon autogen          384         2013-11-18T00:00:00Z 2013-11-25T00:00:00Z 2013-11-25T00:00:00Z 
385 solarmon autogen          385         2013-11-25T00:00:00Z 2013-12-02T00:00:00Z 2013-12-02T00:00:00Z 
386 solarmon autogen          386         2013-12-02T00:00:00Z 2013-12-09T00:00:00Z 2013-12-09T00:00:00Z 
387 solarmon autogen          387         2013-12-09T00:00:00Z 2013-12-16T00:00:00Z 2013-12-16T00:00:00Z 
390 solarmon autogen          390         2013-12-16T00:00:00Z 2013-12-23T00:00:00Z 2013-12-23T00:00:00Z 
393 solarmon autogen          393         2013-12-23T00:00:00Z 2013-12-30T00:00:00Z 2013-12-30T00:00:00Z 
391 solarmon autogen          391         2013-12-30T00:00:00Z 2014-01-06T00:00:00Z 2014-01-06T00:00:00Z 
392 solarmon autogen          392         2014-01-06T00:00:00Z 2014-01-13T00:00:00Z 2014-01-13T00:00:00Z 
394 solarmon autogen          394         2014-01-13T00:00:00Z 2014-01-20T00:00:00Z 2014-01-20T00:00:00Z 
395 solarmon autogen          395         2014-01-20T00:00:00Z 2014-01-27T00:00:00Z 2014-01-27T00:00:00Z 
396 solarmon autogen          396         2014-01-27T00:00:00Z 2014-02-03T00:00:00Z 2014-02-03T00:00:00Z 
397 solarmon autogen          397         2014-02-03T00:00:00Z 2014-02-10T00:00:00Z 2014-02-10T00:00:00Z 
398 solarmon autogen          398         2014-02-10T00:00:00Z 2014-02-17T00:00:00Z 2014-02-17T00:00:00Z 
399 solarmon autogen          399         2014-02-17T00:00:00Z 2014-02-24T00:00:00Z 2014-02-24T00:00:00Z 
400 solarmon autogen          400         2014-02-24T00:00:00Z 2014-03-03T00:00:00Z 2014-03-03T00:00:00Z 
401 solarmon autogen          401         2014-03-03T00:00:00Z 2014-03-10T00:00:00Z 2014-03-10T00:00:00Z 
402 solarmon autogen          402         2014-03-10T00:00:00Z 2014-03-17T00:00:00Z 2014-03-17T00:00:00Z 
405 solarmon autogen          405         2014-03-17T00:00:00Z 2014-03-24T00:00:00Z 2014-03-24T00:00:00Z 
406 solarmon autogen          406         2014-03-24T00:00:00Z 2014-03-31T00:00:00Z 2014-03-31T00:00:00Z 
407 solarmon autogen          407         2014-03-31T00:00:00Z 2014-04-07T00:00:00Z 2014-04-07T00:00:00Z 
408 solarmon autogen          408         2014-04-07T00:00:00Z 2014-04-14T00:00:00Z 2014-04-14T00:00:00Z 
409 solarmon autogen          409         2014-04-14T00:00:00Z 2014-04-21T00:00:00Z 2014-04-21T00:00:00Z 
410 solarmon autogen          410         2014-04-21T00:00:00Z 2014-04-28T00:00:00Z 2014-04-28T00:00:00Z 
411 solarmon autogen          411         2014-04-28T00:00:00Z 2014-05-05T00:00:00Z 2014-05-05T00:00:00Z 
412 solarmon autogen          412         2014-05-05T00:00:00Z 2014-05-12T00:00:00Z 2014-05-12T00:00:00Z 
413 solarmon autogen          413         2014-05-12T00:00:00Z 2014-05-19T00:00:00Z 2014-05-19T00:00:00Z 
414 solarmon autogen          414         2014-05-19T00:00:00Z 2014-05-26T00:00:00Z 2014-05-26T00:00:00Z 
415 solarmon autogen          415         2014-05-26T00:00:00Z 2014-06-02T00:00:00Z 2014-06-02T00:00:00Z 
416 solarmon autogen          416         2014-06-02T00:00:00Z 2014-06-09T00:00:00Z 2014-06-09T00:00:00Z 
417 solarmon autogen          417         2014-06-09T00:00:00Z 2014-06-16T00:00:00Z 2014-06-16T00:00:00Z 
420 solarmon autogen          420         2014-06-16T00:00:00Z 2014-06-23T00:00:00Z 2014-06-23T00:00:00Z 
421 solarmon autogen          421         2014-06-23T00:00:00Z 2014-06-30T00:00:00Z 2014-06-30T00:00:00Z 
422 solarmon autogen          422         2014-06-30T00:00:00Z 2014-07-07T00:00:00Z 2014-07-07T00:00:00Z 
423 solarmon autogen          423         2014-07-07T00:00:00Z 2014-07-14T00:00:00Z 2014-07-14T00:00:00Z 
424 solarmon autogen          424         2014-07-14T00:00:00Z 2014-07-21T00:00:00Z 2014-07-21T00:00:00Z 
425 solarmon autogen          425         2014-07-21T00:00:00Z 2014-07-28T00:00:00Z 2014-07-28T00:00:00Z 
426 solarmon autogen          426         2014-07-28T00:00:00Z 2014-08-04T00:00:00Z 2014-08-04T00:00:00Z 
427 solarmon autogen          427         2014-08-04T00:00:00Z 2014-08-11T00:00:00Z 2014-08-11T00:00:00Z 
428 solarmon autogen          428         2014-08-11T00:00:00Z 2014-08-18T00:00:00Z 2014-08-18T00:00:00Z 
429 solarmon autogen          429         2014-08-18T00:00:00Z 2014-08-25T00:00:00Z 2014-08-25T00:00:00Z 
430 solarmon autogen          430         2014-08-25T00:00:00Z 2014-09-01T00:00:00Z 2014-09-01T00:00:00Z 
431 solarmon autogen          431         2014-09-01T00:00:00Z 2014-09-08T00:00:00Z 2014-09-08T00:00:00Z 
434 solarmon autogen          434         2014-09-08T00:00:00Z 2014-09-15T00:00:00Z 2014-09-15T00:00:00Z 
435 solarmon autogen          435         2014-09-15T00:00:00Z 2014-09-22T00:00:00Z 2014-09-22T00:00:00Z 
436 solarmon autogen          436         2014-09-22T00:00:00Z 2014-09-29T00:00:00Z 2014-09-29T00:00:00Z 
437 solarmon autogen          437         2014-09-29T00:00:00Z 2014-10-06T00:00:00Z 2014-10-06T00:00:00Z 
438 solarmon autogen          438         2014-10-06T00:00:00Z 2014-10-13T00:00:00Z 2014-10-13T00:00:00Z 
439 solarmon autogen          439         2014-10-13T00:00:00Z 2014-10-20T00:00:00Z 2014-10-20T00:00:00Z 
440 solarmon autogen          440         2014-10-20T00:00:00Z 2014-10-27T00:00:00Z 2014-10-27T00:00:00Z 
441 solarmon autogen          441         2014-10-27T00:00:00Z 2014-11-03T00:00:00Z 2014-11-03T00:00:00Z 
442 solarmon autogen          442         2014-11-03T00:00:00Z 2014-11-10T00:00:00Z 2014-11-10T00:00:00Z 
443 solarmon autogen          443         2014-11-10T00:00:00Z 2014-11-17T00:00:00Z 2014-11-17T00:00:00Z 
444 solarmon autogen          444         2014-11-17T00:00:00Z 2014-11-24T00:00:00Z 2014-11-24T00:00:00Z 
445 solarmon autogen          445         2014-11-24T00:00:00Z 2014-12-01T00:00:00Z 2014-12-01T00:00:00Z 
446 solarmon autogen          446         2014-12-01T00:00:00Z 2014-12-08T00:00:00Z 2014-12-08T00:00:00Z 
449 solarmon autogen          449         2014-12-08T00:00:00Z 2014-12-15T00:00:00Z 2014-12-15T00:00:00Z 
450 solarmon autogen          450         2014-12-15T00:00:00Z 2014-12-22T00:00:00Z 2014-12-22T00:00:00Z 
451 solarmon autogen          451         2014-12-22T00:00:00Z 2014-12-29T00:00:00Z 2014-12-29T00:00:00Z 
452 solarmon autogen          452         2014-12-29T00:00:00Z 2015-01-05T00:00:00Z 2015-01-05T00:00:00Z 
454 solarmon autogen          454         2015-01-05T00:00:00Z 2015-01-12T00:00:00Z 2015-01-12T00:00:00Z 
455 solarmon autogen          455         2015-01-12T00:00:00Z 2015-01-19T00:00:00Z 2015-01-19T00:00:00Z 
456 solarmon autogen          456         2015-01-19T00:00:00Z 2015-01-26T00:00:00Z 2015-01-26T00:00:00Z 
457 solarmon autogen          457         2015-01-26T00:00:00Z 2015-02-02T00:00:00Z 2015-02-02T00:00:00Z 
458 solarmon autogen          458         2015-02-02T00:00:00Z 2015-02-09T00:00:00Z 2015-02-09T00:00:00Z 
459 solarmon autogen          459         2015-02-09T00:00:00Z 2015-02-16T00:00:00Z 2015-02-16T00:00:00Z 
460 solarmon autogen          460         2015-02-16T00:00:00Z 2015-02-23T00:00:00Z 2015-02-23T00:00:00Z 
461 solarmon autogen          461         2015-02-23T00:00:00Z 2015-03-02T00:00:00Z 2015-03-02T00:00:00Z 
462 solarmon autogen          462         2015-03-02T00:00:00Z 2015-03-09T00:00:00Z 2015-03-09T00:00:00Z 
465 solarmon autogen          465         2015-03-09T00:00:00Z 2015-03-16T00:00:00Z 2015-03-16T00:00:00Z 
466 solarmon autogen          466         2015-03-16T00:00:00Z 2015-03-23T00:00:00Z 2015-03-23T00:00:00Z 
467 solarmon autogen          467         2015-03-23T00:00:00Z 2015-03-30T00:00:00Z 2015-03-30T00:00:00Z 
468 solarmon autogen          468         2015-03-30T00:00:00Z 2015-04-06T00:00:00Z 2015-04-06T00:00:00Z 
469 solarmon autogen          469         2015-04-06T00:00:00Z 2015-04-13T00:00:00Z 2015-04-13T00:00:00Z 
470 solarmon autogen          470         2015-04-13T00:00:00Z 2015-04-20T00:00:00Z 2015-04-20T00:00:00Z 
471 solarmon autogen          471         2015-04-20T00:00:00Z 2015-04-27T00:00:00Z 2015-04-27T00:00:00Z 
472 solarmon autogen          472         2015-04-27T00:00:00Z 2015-05-04T00:00:00Z 2015-05-04T00:00:00Z 
473 solarmon autogen          473         2015-05-04T00:00:00Z 2015-05-11T00:00:00Z 2015-05-11T00:00:00Z 
474 solarmon autogen          474         2015-05-11T00:00:00Z 2015-05-18T00:00:00Z 2015-05-18T00:00:00Z 
475 solarmon autogen          475         2015-05-18T00:00:00Z 2015-05-25T00:00:00Z 2015-05-25T00:00:00Z 
476 solarmon autogen          476         2015-05-25T00:00:00Z 2015-06-01T00:00:00Z 2015-06-01T00:00:00Z 
477 solarmon autogen          477         2015-06-01T00:00:00Z 2015-06-08T00:00:00Z 2015-06-08T00:00:00Z 
480 solarmon autogen          480         2015-06-08T00:00:00Z 2015-06-15T00:00:00Z 2015-06-15T00:00:00Z 
481 solarmon autogen          481         2015-06-15T00:00:00Z 2015-06-22T00:00:00Z 2015-06-22T00:00:00Z 
482 solarmon autogen          482         2015-06-22T00:00:00Z 2015-06-29T00:00:00Z 2015-06-29T00:00:00Z 
483 solarmon autogen          483         2015-06-29T00:00:00Z 2015-07-06T00:00:00Z 2015-07-06T00:00:00Z 
484 solarmon autogen          484         2015-07-06T00:00:00Z 2015-07-13T00:00:00Z 2015-07-13T00:00:00Z 
485 solarmon autogen          485         2015-07-13T00:00:00Z 2015-07-20T00:00:00Z 2015-07-20T00:00:00Z 
486 solarmon autogen          486         2015-07-20T00:00:00Z 2015-07-27T00:00:00Z 2015-07-27T00:00:00Z 
487 solarmon autogen          487         2015-07-27T00:00:00Z 2015-08-03T00:00:00Z 2015-08-03T00:00:00Z 
488 solarmon autogen          488         2015-08-03T00:00:00Z 2015-08-10T00:00:00Z 2015-08-10T00:00:00Z 
489 solarmon autogen          489         2015-08-10T00:00:00Z 2015-08-17T00:00:00Z 2015-08-17T00:00:00Z 
490 solarmon autogen          490         2015-08-17T00:00:00Z 2015-08-24T00:00:00Z 2015-08-24T00:00:00Z 
491 solarmon autogen          491         2015-08-24T00:00:00Z 2015-08-31T00:00:00Z 2015-08-31T00:00:00Z 
492 solarmon autogen          492         2015-08-31T00:00:00Z 2015-09-07T00:00:00Z 2015-09-07T00:00:00Z 
495 solarmon autogen          495         2015-09-07T00:00:00Z 2015-09-14T00:00:00Z 2015-09-14T00:00:00Z 
496 solarmon autogen          496         2015-09-14T00:00:00Z 2015-09-21T00:00:00Z 2015-09-21T00:00:00Z 
497 solarmon autogen          497         2015-09-21T00:00:00Z 2015-09-28T00:00:00Z 2015-09-28T00:00:00Z 
498 solarmon autogen          498         2015-09-28T00:00:00Z 2015-10-05T00:00:00Z 2015-10-05T00:00:00Z 
499 solarmon autogen          499         2015-10-05T00:00:00Z 2015-10-12T00:00:00Z 2015-10-12T00:00:00Z 
500 solarmon autogen          500         2015-10-12T00:00:00Z 2015-10-19T00:00:00Z 2015-10-19T00:00:00Z 
501 solarmon autogen          501         2015-10-19T00:00:00Z 2015-10-26T00:00:00Z 2015-10-26T00:00:00Z 
502 solarmon autogen          502         2015-10-26T00:00:00Z 2015-11-02T00:00:00Z 2015-11-02T00:00:00Z 
503 solarmon autogen          503         2015-11-02T00:00:00Z 2015-11-09T00:00:00Z 2015-11-09T00:00:00Z 
504 solarmon autogen          504         2015-11-09T00:00:00Z 2015-11-16T00:00:00Z 2015-11-16T00:00:00Z 
505 solarmon autogen          505         2015-11-16T00:00:00Z 2015-11-23T00:00:00Z 2015-11-23T00:00:00Z 
506 solarmon autogen          506         2015-11-23T00:00:00Z 2015-11-30T00:00:00Z 2015-11-30T00:00:00Z 
509 solarmon autogen          509         2015-11-30T00:00:00Z 2015-12-07T00:00:00Z 2015-12-07T00:00:00Z 
510 solarmon autogen          510         2015-12-07T00:00:00Z 2015-12-14T00:00:00Z 2015-12-14T00:00:00Z 
511 solarmon autogen          511         2015-12-14T00:00:00Z 2015-12-21T00:00:00Z 2015-12-21T00:00:00Z 
512 solarmon autogen          512         2015-12-21T00:00:00Z 2015-12-28T00:00:00Z 2015-12-28T00:00:00Z 
513 solarmon autogen          513         2015-12-28T00:00:00Z 2016-01-04T00:00:00Z 2016-01-04T00:00:00Z 
515 solarmon autogen          515         2016-01-04T00:00:00Z 2016-01-11T00:00:00Z 2016-01-11T00:00:00Z 
516 solarmon autogen          516         2016-01-11T00:00:00Z 2016-01-18T00:00:00Z 2016-01-18T00:00:00Z 
517 solarmon autogen          517         2016-01-18T00:00:00Z 2016-01-25T00:00:00Z 2016-01-25T00:00:00Z 
518 solarmon autogen          518         2016-01-25T00:00:00Z 2016-02-01T00:00:00Z 2016-02-01T00:00:00Z 
519 solarmon autogen          519         2016-02-01T00:00:00Z 2016-02-08T00:00:00Z 2016-02-08T00:00:00Z 
520 solarmon autogen          520         2016-02-08T00:00:00Z 2016-02-15T00:00:00Z 2016-02-15T00:00:00Z 
521 solarmon autogen          521         2016-02-15T00:00:00Z 2016-02-22T00:00:00Z 2016-02-22T00:00:00Z 
522 solarmon autogen          522         2016-02-22T00:00:00Z 2016-02-29T00:00:00Z 2016-02-29T00:00:00Z 
525 solarmon autogen          525         2016-02-29T00:00:00Z 2016-03-07T00:00:00Z 2016-03-07T00:00:00Z 
526 solarmon autogen          526         2016-03-07T00:00:00Z 2016-03-14T00:00:00Z 2016-03-14T00:00:00Z 
527 solarmon autogen          527         2016-03-14T00:00:00Z 2016-03-21T00:00:00Z 2016-03-21T00:00:00Z 
528 solarmon autogen          528         2016-03-21T00:00:00Z 2016-03-28T00:00:00Z 2016-03-28T00:00:00Z 
529 solarmon autogen          529         2016-03-28T00:00:00Z 2016-04-04T00:00:00Z 2016-04-04T00:00:00Z 
530 solarmon autogen          530         2016-04-04T00:00:00Z 2016-04-11T00:00:00Z 2016-04-11T00:00:00Z 
531 solarmon autogen          531         2016-04-11T00:00:00Z 2016-04-18T00:00:00Z 2016-04-18T00:00:00Z 
532 solarmon autogen          532         2016-04-18T00:00:00Z 2016-04-25T00:00:00Z 2016-04-25T00:00:00Z 
533 solarmon autogen          533         2016-04-25T00:00:00Z 2016-05-02T00:00:00Z 2016-05-02T00:00:00Z 
534 solarmon autogen          534         2016-05-02T00:00:00Z 2016-05-09T00:00:00Z 2016-05-09T00:00:00Z 
535 solarmon autogen          535         2016-05-09T00:00:00Z 2016-05-16T00:00:00Z 2016-05-16T00:00:00Z 
536 solarmon autogen          536         2016-05-16T00:00:00Z 2016-05-23T00:00:00Z 2016-05-23T00:00:00Z 
537 solarmon autogen          537         2016-05-23T00:00:00Z 2016-05-30T00:00:00Z 2016-05-30T00:00:00Z 
540 solarmon autogen          540         2016-05-30T00:00:00Z 2016-06-06T00:00:00Z 2016-06-06T00:00:00Z 
541 solarmon autogen          541         2016-06-06T00:00:00Z 2016-06-13T00:00:00Z 2016-06-13T00:00:00Z 
542 solarmon autogen          542         2016-06-13T00:00:00Z 2016-06-20T00:00:00Z 2016-06-20T00:00:00Z 
543 solarmon autogen          543         2016-06-20T00:00:00Z 2016-06-27T00:00:00Z 2016-06-27T00:00:00Z 
545 solarmon autogen          545         2016-06-27T00:00:00Z 2016-07-04T00:00:00Z 2016-07-04T00:00:00Z 
546 solarmon autogen          546         2016-07-04T00:00:00Z 2016-07-11T00:00:00Z 2016-07-11T00:00:00Z 
547 solarmon autogen          547         2016-07-11T00:00:00Z 2016-07-18T00:00:00Z 2016-07-18T00:00:00Z 
548 solarmon autogen          548         2016-07-18T00:00:00Z 2016-07-25T00:00:00Z 2016-07-25T00:00:00Z 
549 solarmon autogen          549         2016-07-25T00:00:00Z 2016-08-01T00:00:00Z 2016-08-01T00:00:00Z 
550 solarmon autogen          550         2016-08-01T00:00:00Z 2016-08-08T00:00:00Z 2016-08-08T00:00:00Z 
551 solarmon autogen          551         2016-08-08T00:00:00Z 2016-08-15T00:00:00Z 2016-08-15T00:00:00Z 
552 solarmon autogen          552         2016-08-15T00:00:00Z 2016-08-22T00:00:00Z 2016-08-22T00:00:00Z 
553 solarmon autogen          553         2016-08-22T00:00:00Z 2016-08-29T00:00:00Z 2016-08-29T00:00:00Z 
556 solarmon autogen          556         2016-08-29T00:00:00Z 2016-09-05T00:00:00Z 2016-09-05T00:00:00Z 
557 solarmon autogen          557         2016-09-05T00:00:00Z 2016-09-12T00:00:00Z 2016-09-12T00:00:00Z 
558 solarmon autogen          558         2016-09-12T00:00:00Z 2016-09-19T00:00:00Z 2016-09-19T00:00:00Z 
559 solarmon autogen          559         2016-09-19T00:00:00Z 2016-09-26T00:00:00Z 2016-09-26T00:00:00Z 
560 solarmon autogen          560         2016-09-26T00:00:00Z 2016-10-03T00:00:00Z 2016-10-03T00:00:00Z 
561 solarmon autogen          561         2016-10-03T00:00:00Z 2016-10-10T00:00:00Z 2016-10-10T00:00:00Z 
562 solarmon autogen          562         2016-10-10T00:00:00Z 2016-10-17T00:00:00Z 2016-10-17T00:00:00Z 
563 solarmon autogen          563         2016-10-17T00:00:00Z 2016-10-24T00:00:00Z 2016-10-24T00:00:00Z 
564 solarmon autogen          564         2016-10-24T00:00:00Z 2016-10-31T00:00:00Z 2016-10-31T00:00:00Z 
565 solarmon autogen          565         2016-10-31T00:00:00Z 2016-11-07T00:00:00Z 2016-11-07T00:00:00Z 
566 solarmon autogen          566         2016-11-07T00:00:00Z 2016-11-14T00:00:00Z 2016-11-14T00:00:00Z 
567 solarmon autogen          567         2016-11-14T00:00:00Z 2016-11-21T00:00:00Z 2016-11-21T00:00:00Z 
568 solarmon autogen          568         2016-11-21T00:00:00Z 2016-11-28T00:00:00Z 2016-11-28T00:00:00Z 
571 solarmon autogen          571         2016-11-28T00:00:00Z 2016-12-05T00:00:00Z 2016-12-05T00:00:00Z 
572 solarmon autogen          572         2016-12-05T00:00:00Z 2016-12-12T00:00:00Z 2016-12-12T00:00:00Z 
573 solarmon autogen          573         2016-12-12T00:00:00Z 2016-12-19T00:00:00Z 2016-12-19T00:00:00Z 
574 solarmon autogen          574         2016-12-19T00:00:00Z 2016-12-26T00:00:00Z 2016-12-26T00:00:00Z 
575 solarmon autogen          575         2016-12-26T00:00:00Z 2017-01-02T00:00:00Z 2017-01-02T00:00:00Z 
577 solarmon autogen          577         2017-01-02T00:00:00Z 2017-01-09T00:00:00Z 2017-01-09T00:00:00Z 
578 solarmon autogen          578         2017-01-09T00:00:00Z 2017-01-16T00:00:00Z 2017-01-16T00:00:00Z 
579 solarmon autogen          579         2017-01-16T00:00:00Z 2017-01-23T00:00:00Z 2017-01-23T00:00:00Z 
580 solarmon autogen          580         2017-01-23T00:00:00Z 2017-01-30T00:00:00Z 2017-01-30T00:00:00Z 
581 solarmon autogen          581         2017-01-30T00:00:00Z 2017-02-06T00:00:00Z 2017-02-06T00:00:00Z 
582 solarmon autogen          582         2017-02-06T00:00:00Z 2017-02-13T00:00:00Z 2017-02-13T00:00:00Z 
583 solarmon autogen          583         2017-02-13T00:00:00Z 2017-02-20T00:00:00Z 2017-02-20T00:00:00Z 
584 solarmon autogen          584         2017-02-20T00:00:00Z 2017-02-27T00:00:00Z 2017-02-27T00:00:00Z 
587 solarmon autogen          587         2017-02-27T00:00:00Z 2017-03-06T00:00:00Z 2017-03-06T00:00:00Z 
588 solarmon autogen          588         2017-03-06T00:00:00Z 2017-03-13T00:00:00Z 2017-03-13T00:00:00Z 
589 solarmon autogen          589         2017-03-13T00:00:00Z 2017-03-20T00:00:00Z 2017-03-20T00:00:00Z 
590 solarmon autogen          590         2017-03-20T00:00:00Z 2017-03-27T00:00:00Z 2017-03-27T00:00:00Z 
591 solarmon autogen          591         2017-03-27T00:00:00Z 2017-04-03T00:00:00Z 2017-04-03T00:00:00Z 
592 solarmon autogen          592         2017-04-03T00:00:00Z 2017-04-10T00:00:00Z 2017-04-10T00:00:00Z 
593 solarmon autogen          593         2017-04-10T00:00:00Z 2017-04-17T00:00:00Z 2017-04-17T00:00:00Z 
594 solarmon autogen          594         2017-04-17T00:00:00Z 2017-04-24T00:00:00Z 2017-04-24T00:00:00Z 
595 solarmon autogen          595         2017-04-24T00:00:00Z 2017-05-01T00:00:00Z 2017-05-01T00:00:00Z 
596 solarmon autogen          596         2017-05-01T00:00:00Z 2017-05-08T00:00:00Z 2017-05-08T00:00:00Z 
597 solarmon autogen          597         2017-05-08T00:00:00Z 2017-05-15T00:00:00Z 2017-05-15T00:00:00Z 
601 solarmon autogen          601         2017-05-15T00:00:00Z 2017-05-22T00:00:00Z 2017-05-22T00:00:00Z 
619 solarmon autogen          619         2017-05-22T00:00:00Z 2017-05-29T00:00:00Z 2017-05-29T00:00:00Z 
605 solarmon autogen          605         2017-05-29T00:00:00Z 2017-06-05T00:00:00Z 2017-06-05T00:00:00Z 
634 solarmon autogen          634         2017-06-05T00:00:00Z 2017-06-12T00:00:00Z 2017-06-12T00:00:00Z 
642 solarmon autogen          642         2017-06-12T00:00:00Z 2017-06-19T00:00:00Z 2017-06-19T00:00:00Z 
604 solarmon autogen          604         2017-09-18T00:00:00Z 2017-09-25T00:00:00Z 2017-09-25T00:00:00Z 
603 solarmon autogen          603         2017-10-09T00:00:00Z 2017-10-16T00:00:00Z 2017-10-16T00:00:00Z 


name: solarmon_5min
id  database      retention_policy shard_group start_time           end_time             expiry_time          owners
--  --------      ---------------- ----------- ----------           --------             -----------          ------
615 solarmon_5min autogen          615         2011-06-23T00:00:00Z 2011-09-21T00:00:00Z 2011-09-21T00:00:00Z 
646 solarmon_5min autogen          646         2012-12-14T00:00:00Z 2013-03-14T00:00:00Z 2013-03-14T00:00:00Z 
360 solarmon_5min autogen          360         2013-03-14T00:00:00Z 2013-06-12T00:00:00Z 2013-06-12T00:00:00Z 
361 solarmon_5min autogen          361         2013-06-12T00:00:00Z 2013-09-10T00:00:00Z 2013-09-10T00:00:00Z 
379 solarmon_5min autogen          379         2013-09-10T00:00:00Z 2013-12-09T00:00:00Z 2013-12-09T00:00:00Z 
389 solarmon_5min autogen          389         2013-12-09T00:00:00Z 2014-03-09T00:00:00Z 2014-03-09T00:00:00Z 
404 solarmon_5min autogen          404         2014-03-09T00:00:00Z 2014-06-07T00:00:00Z 2014-06-07T00:00:00Z 
419 solarmon_5min autogen          419         2014-06-07T00:00:00Z 2014-09-05T00:00:00Z 2014-09-05T00:00:00Z 
433 solarmon_5min autogen          433         2014-09-05T00:00:00Z 2014-12-04T00:00:00Z 2014-12-04T00:00:00Z 
448 solarmon_5min autogen          448         2014-12-04T00:00:00Z 2015-03-04T00:00:00Z 2015-03-04T00:00:00Z 
464 solarmon_5min autogen          464         2015-03-04T00:00:00Z 2015-06-02T00:00:00Z 2015-06-02T00:00:00Z 
479 solarmon_5min autogen          479         2015-06-02T00:00:00Z 2015-08-31T00:00:00Z 2015-08-31T00:00:00Z 
494 solarmon_5min autogen          494         2015-08-31T00:00:00Z 2015-11-29T00:00:00Z 2015-11-29T00:00:00Z 
508 solarmon_5min autogen          508         2015-11-29T00:00:00Z 2016-02-27T00:00:00Z 2016-02-27T00:00:00Z 
524 solarmon_5min autogen          524         2016-02-27T00:00:00Z 2016-05-27T00:00:00Z 2016-05-27T00:00:00Z 
539 solarmon_5min autogen          539         2016-05-27T00:00:00Z 2016-08-25T00:00:00Z 2016-08-25T00:00:00Z 
555 solarmon_5min autogen          555         2016-08-25T00:00:00Z 2016-11-23T00:00:00Z 2016-11-23T00:00:00Z 
570 solarmon_5min autogen          570         2016-11-23T00:00:00Z 2017-02-21T00:00:00Z 2017-02-21T00:00:00Z 
586 solarmon_5min autogen          586         2017-02-21T00:00:00Z 2017-05-22T00:00:00Z 2017-05-22T00:00:00Z 
609 solarmon_5min autogen          609         2017-05-22T00:00:00Z 2017-08-20T00:00:00Z 2017-08-20T00:00:00Z 
607 solarmon_5min autogen          607         2017-08-20T00:00:00Z 2017-11-18T00:00:00Z 2017-11-18T00:00:00Z 


name: solarmon_30min
id  database       retention_policy shard_group start_time           end_time             expiry_time          owners
--  --------       ---------------- ----------- ----------           --------             -----------          ------
614 solarmon_30min autogen          614         2011-06-23T00:00:00Z 2011-09-21T00:00:00Z 2011-09-21T00:00:00Z 
645 solarmon_30min autogen          645         2012-12-14T00:00:00Z 2013-03-14T00:00:00Z 2013-03-14T00:00:00Z 
358 solarmon_30min autogen          358         2013-03-14T00:00:00Z 2013-06-12T00:00:00Z 2013-06-12T00:00:00Z 
359 solarmon_30min autogen          359         2013-06-12T00:00:00Z 2013-09-10T00:00:00Z 2013-09-10T00:00:00Z 
378 solarmon_30min autogen          378         2013-09-10T00:00:00Z 2013-12-09T00:00:00Z 2013-12-09T00:00:00Z 
388 solarmon_30min autogen          388         2013-12-09T00:00:00Z 2014-03-09T00:00:00Z 2014-03-09T00:00:00Z 
403 solarmon_30min autogen          403         2014-03-09T00:00:00Z 2014-06-07T00:00:00Z 2014-06-07T00:00:00Z 
418 solarmon_30min autogen          418         2014-06-07T00:00:00Z 2014-09-05T00:00:00Z 2014-09-05T00:00:00Z 
432 solarmon_30min autogen          432         2014-09-05T00:00:00Z 2014-12-04T00:00:00Z 2014-12-04T00:00:00Z 
447 solarmon_30min autogen          447         2014-12-04T00:00:00Z 2015-03-04T00:00:00Z 2015-03-04T00:00:00Z 
463 solarmon_30min autogen          463         2015-03-04T00:00:00Z 2015-06-02T00:00:00Z 2015-06-02T00:00:00Z 
478 solarmon_30min autogen          478         2015-06-02T00:00:00Z 2015-08-31T00:00:00Z 2015-08-31T00:00:00Z 
493 solarmon_30min autogen          493         2015-08-31T00:00:00Z 2015-11-29T00:00:00Z 2015-11-29T00:00:00Z 
507 solarmon_30min autogen          507         2015-11-29T00:00:00Z 2016-02-27T00:00:00Z 2016-02-27T00:00:00Z 
523 solarmon_30min autogen          523         2016-02-27T00:00:00Z 2016-05-27T00:00:00Z 2016-05-27T00:00:00Z 
538 solarmon_30min autogen          538         2016-05-27T00:00:00Z 2016-08-25T00:00:00Z 2016-08-25T00:00:00Z 
554 solarmon_30min autogen          554         2016-08-25T00:00:00Z 2016-11-23T00:00:00Z 2016-11-23T00:00:00Z 
569 solarmon_30min autogen          569         2016-11-23T00:00:00Z 2017-02-21T00:00:00Z 2017-02-21T00:00:00Z 
585 solarmon_30min autogen          585         2017-02-21T00:00:00Z 2017-05-22T00:00:00Z 2017-05-22T00:00:00Z 
608 solarmon_30min autogen          608         2017-05-22T00:00:00Z 2017-08-20T00:00:00Z 2017-08-20T00:00:00Z 
606 solarmon_30min autogen          606         2017-08-20T00:00:00Z 2017-11-18T00:00:00Z 2017-11-18T00:00:00Z 

> exit

#7
Connected to http://localhost:8086 version 1.2.2
InfluxDB shell version: 1.2.2
> use solarmon
Using database solarmon
> show field keys
name: battery
fieldKey    fieldType
--------    ---------
Abattery    float
Fac         float
Pac         float
Pac-0       float
VAac        float
Pdc         float
VAac-0      float
Vac         float
Vac-0       float
VCmax       float
__saved     integer
VCmin       float
chargeKWh   float
eExport     float
eImport     float
Vbattery    float
eToday      float
Vdc         float
powerFactor float
temp        float
charge      float
timeTotal   float

name: batteryinverter
fieldKey fieldType
-------- ---------
Fac      float
Pac      float
Pbattery float
Pdc      float
Pload    float
VAac     float
Vac      float
Vbattery float
Vdc      float
__saved  integer
charge   float
temp     float

name: hybridinverter
fieldKey     fieldType
--------     ---------
Fac          float
Pac          float
Pac-0        float
Pbattery     float
Pload        float
Pbattery-0   float
Ppv-0        float
Ppv-1        float
Pload-0      float
VAac         float
Ppv          float
Vac          float
Vbattery     float
Vload        float
Vpv-0        float
VAac-0       float
Vpv-1        float
__saved      integer
Vac-0        float
charge       float
eExport      float
Vbattery-0   float
eToday       float
temp         float
Vload-0      float
Vpv          float
battery_temp float

name: inverter
fieldKey    fieldType
--------    ---------
Fac         float
Pac         float
Ppv         float
Pac-0       float
Ppv-0       float
Pac-1       float
Ppv-1       float
Pac-2       float
VAac        float
Vac         float
Vpv         float
Vpv-0       float
Vpv-1       float
VAac-0      float
__saved     integer
VAac-1      float
eExport     float
VAac-2      float
eImport     float
eToday      float
Vac-0       float
powerFactor float
Vac-1       float
temp        float
Vac-2       float
timeTotal   float
Vvac-0      float

name: usagemeter
fieldKey    fieldType
--------    ---------
Fac         float
Pac         float
Pac-0       float
VAac        float
Pac-1       float
Vac         float
Pac-2       float
__saved     integer
eExport     float
VAac-0      float
eImport     float
VAac-1      float
powerFactor float
VAac-2      float
Vac-0       float
Vac-1       float
Vac-2       float
eToday      float
temp        float
timeTotal   float

> use solarmon_5min
Using database solarmon_5min
> show field keys
name: battery
fieldKey        fieldType
--------        ---------
avg_Fac         float
avg_Abattery    float
avg_Pac         float
avg_VAac        float
avg_Vac         float
avg_Pac-0       float
avg___saved     float
avg_Pdc         float
avg_chargeKWh   float
avg_VAac-0      float
avg_eExport     float
avg_VCmax       float
avg_eImport     float
avg_VCmin       float
avg_powerFactor float
max_Fac         float
avg_Vac-0       float
max_Pac         float
avg_Vbattery    float
max_VAac        float
max_Vac         float
avg_Vdc         float
avg_charge      float
max___saved     integer
max_chargeKWh   float
max_eExport     float
max_eImport     float
avg_eToday      float
max_powerFactor float
min_Fac         float
avg_temp        float
min_Pac         float
avg_timeTotal   float
min_VAac        float
max_Abattery    float
min_Vac         float
min___saved     integer
min_chargeKWh   float
max_Pac-0       float
min_eExport     float
min_eImport     float
max_VAac-0      float
min_powerFactor float
max_Pdc         float
max_VCmax       float
max_VCmin       float
max_Vac-0       float
max_Vbattery    float
max_charge      float
max_Vdc         float
max_eToday      float
max_temp        float
max_timeTotal   float
min_Abattery    float
min_Pac-0       float
min_VAac-0      float
min_VCmax       float
min_VCmin       float
min_Pdc         float
min_Vac-0       float
min_Vbattery    float
min_charge      float
min_Vdc         float
min_eToday      float
min_temp        float
min_timeTotal   float

name: batteryinverter
fieldKey     fieldType
--------     ---------
avg_Fac      float
avg_Pac      float
avg_Pbattery float
avg_Pdc      float
avg_Pload    float
avg_VAac     float
avg_Vac      float
avg_Vbattery float
avg_Vdc      float
avg___saved  float
avg_charge   float
avg_temp     float
max_Fac      float
max_Pac      float
max_Pbattery float
max_Pdc      float
max_Pload    float
max_VAac     float
max_Vac      float
max_Vbattery float
max_Vdc      float
max___saved  integer
max_charge   float
max_temp     float
min_Fac      float
min_Pac      float
min_Pbattery float
min_Pdc      float
min_Pload    float
min_VAac     float
min_Vac      float
min_Vbattery float
min_Vdc      float
min___saved  integer
min_charge   float
min_temp     float

name: hybridinverter
fieldKey         fieldType
--------         ---------
avg_Fac          float
avg_Pac          float
avg_Pac-0        float
avg_Pbattery     float
avg_Pload        float
avg_Pbattery-0   float
avg_Ppv-0        float
avg_Ppv-1        float
avg_Pload-0      float
avg_VAac         float
avg_Ppv          float
avg_Vac          float
avg_Vbattery     float
avg_Vload        float
avg_Vpv-0        float
avg_VAac-0       float
avg_Vpv-1        float
avg___saved      float
avg_Vac-0        float
avg_charge       float
avg_eExport      float
avg_Vbattery-0   float
avg_eToday       float
avg_temp         float
avg_Vload-0      float
max_Fac          float
avg_Vpv          float
max_Pac          float
max_Pbattery     float
max_Pload        float
max_Ppv-0        float
avg_battery_temp float
max_Ppv-1        float
max_VAac         float
max_Vac          float
max_Vbattery     float
max_Vload        float
max_Vpv-0        float
max_Vpv-1        float
max_Pac-0        float
max___saved      integer
max_charge       float
max_Pbattery-0   float
max_eExport      float
max_eToday       float
max_Pload-0      float
max_temp         float
max_Ppv          float
min_Fac          float
min_Pac          float
min_Pbattery     float
min_Pload        float
max_VAac-0       float
min_Ppv-0        float
min_Ppv-1        float
max_Vac-0        float
min_VAac         float
min_Vac          float
max_Vbattery-0   float
min_Vbattery     float
min_Vload        float
max_Vload-0      float
min_Vpv-0        float
max_Vpv          float
min_Vpv-1        float
min___saved      integer
min_charge       float
min_eExport      float
max_battery_temp float
min_eToday       float
min_temp         float
min_Pac-0        float
min_Pbattery-0   float
min_Pload-0      float
min_Ppv          float
min_VAac-0       float
min_Vac-0        float
min_Vbattery-0   float
min_Vload-0      float
min_Vpv          float
min_battery_temp float

name: inverter
fieldKey        fieldType
--------        ---------
avg_Fac         float
avg_Pac         float
avg_Pac-0       float
avg_Ppv         float
avg_Pac-1       float
avg_Ppv-0       float
avg_Pac-2       float
avg_Ppv-1       float
avg_VAac        float
avg_VAac-0      float
avg_Vac         float
avg_Vac-0       float
avg_Vpv         float
avg_VAac-1      float
avg_Vpv-0       float
avg_VAac-2      float
avg_Vpv-1       float
avg___saved     float
avg_eExport     float
avg_Vac-1       float
avg_eImport     float
avg_Vac-2       float
avg_eToday      float
avg_powerFactor float
avg_temp        float
avg_timeTotal   float
avg_Vvac-0      float
max_Fac         float
max_Pac         float
max_Pac-0       float
max_Ppv         float
max_Ppv-0       float
max_Ppv-1       float
max_VAac        float
max_VAac-0      float
max_Vac         float
max_Vac-0       float
max_Vpv         float
max_Pac-1       float
max_Vpv-0       float
max_Pac-2       float
max_Vpv-1       float
max___saved     integer
max_eExport     float
max_eImport     float
max_eToday      float
max_powerFactor float
max_VAac-1      float
max_temp        float
max_VAac-2      float
max_timeTotal   float
min_Fac         float
min_Pac         float
max_Vac-1       float
min_Pac-0       float
max_Vac-2       float
min_Ppv         float
min_Ppv-0       float
min_Ppv-1       float
min_VAac        float
max_Vvac-0      float
min_VAac-0      float
min_Vac         float
min_Vac-0       float
min_Vpv         float
min_Vpv-0       float
min_Vpv-1       float
min___saved     integer
min_eExport     float
min_eImport     float
min_eToday      float
min_powerFactor float
min_Pac-1       float
min_temp        float
min_Pac-2       float
min_timeTotal   float
min_VAac-1      float
min_VAac-2      float
min_Vac-1       float
min_Vac-2       float
min_Vvac-0      float

name: usagemeter
fieldKey        fieldType
--------        ---------
avg_Fac         float
avg_Pac         float
avg_VAac        float
avg_Vac         float
avg___saved     float
avg_eExport     float
avg_eImport     float
avg_powerFactor float
max_Fac         float
max_Pac         float
max_VAac        float
max_Vac         float
max___saved     integer
max_eExport     float
max_eImport     float
max_powerFactor float
min_Fac         float
min_Pac         float
min_VAac        float
min_Vac         float
min___saved     integer
min_eExport     float
min_eImport     float
min_powerFactor float
avg_Pac-0       float
avg_Pac-1       float
avg_Pac-2       float
avg_VAac-0      float
avg_VAac-1      float
avg_VAac-2      float
avg_Vac-0       float
avg_Vac-1       float
avg_Vac-2       float
avg_eToday      float
avg_temp        float
avg_timeTotal   float
max_Pac-0       float
max_Pac-1       float
max_Pac-2       float
max_VAac-0      float
max_VAac-1      float
max_VAac-2      float
max_Vac-0       float
max_Vac-1       float
max_Vac-2       float
max_eToday      float
max_temp        float
max_timeTotal   float
min_Pac-0       float
min_Pac-1       float
min_Pac-2       float
min_VAac-0      float
min_VAac-1      float
min_VAac-2      float
min_Vac-0       float
min_Vac-1       float
min_Vac-2       float
min_eToday      float
min_temp        float
min_timeTotal   float

> use solarmon_30min
Using database solarmon_30min
> show field keys
name: battery
fieldKey        fieldType
--------        ---------
avg_Fac         float
avg_Abattery    float
avg_Pac         float
avg_VAac        float
avg_Vac         float
avg_Pac-0       float
avg___saved     float
avg_Pdc         float
avg_chargeKWh   float
avg_VAac-0      float
avg_eExport     float
avg_VCmax       float
avg_eImport     float
avg_VCmin       float
avg_powerFactor float
max_Fac         float
avg_Vac-0       float
max_Pac         float
avg_Vbattery    float
max_VAac        float
max_Vac         float
avg_Vdc         float
avg_charge      float
max___saved     integer
max_chargeKWh   float
max_eExport     float
max_eImport     float
avg_eToday      float
max_powerFactor float
min_Fac         float
avg_temp        float
min_Pac         float
avg_timeTotal   float
min_VAac        float
max_Abattery    float
min_Vac         float
min___saved     integer
min_chargeKWh   float
max_Pac-0       float
min_eExport     float
min_eImport     float
max_VAac-0      float
min_powerFactor float
max_Pdc         float
max_VCmax       float
max_VCmin       float
max_Vac-0       float
max_Vbattery    float
max_charge      float
max_Vdc         float
max_eToday      float
max_temp        float
max_timeTotal   float
min_Abattery    float
min_Pac-0       float
min_VAac-0      float
min_VCmax       float
min_VCmin       float
min_Pdc         float
min_Vac-0       float
min_Vbattery    float
min_charge      float
min_Vdc         float
min_eToday      float
min_temp        float
min_timeTotal   float

name: batteryinverter
fieldKey     fieldType
--------     ---------
avg_Fac      float
avg_Pac      float
avg_Pbattery float
avg_Pdc      float
avg_Pload    float
avg_VAac     float
avg_Vac      float
avg_Vbattery float
avg_Vdc      float
avg___saved  float
avg_charge   float
avg_temp     float
max_Fac      float
max_Pac      float
max_Pbattery float
max_Pdc      float
max_Pload    float
max_VAac     float
max_Vac      float
max_Vbattery float
max_Vdc      float
max___saved  integer
max_charge   float
max_temp     float
min_Fac      float
min_Pac      float
min_Pbattery float
min_Pdc      float
min_Pload    float
min_VAac     float
min_Vac      float
min_Vbattery float
min_Vdc      float
min___saved  integer
min_charge   float
min_temp     float

name: hybridinverter
fieldKey         fieldType
--------         ---------
avg_Fac          float
avg_Pac          float
avg_Pac-0        float
avg_Pbattery     float
avg_Pload        float
avg_Pbattery-0   float
avg_Ppv-0        float
avg_Ppv-1        float
avg_Pload-0      float
avg_VAac         float
avg_Ppv          float
avg_Vac          float
avg_Vbattery     float
avg_Vload        float
avg_Vpv-0        float
avg_VAac-0       float
avg_Vpv-1        float
avg___saved      float
avg_Vac-0        float
avg_charge       float
avg_eExport      float
avg_Vbattery-0   float
avg_eToday       float
avg_temp         float
avg_Vload-0      float
max_Fac          float
avg_Vpv          float
max_Pac          float
max_Pbattery     float
max_Pload        float
max_Ppv-0        float
avg_battery_temp float
max_Ppv-1        float
max_VAac         float
max_Vac          float
max_Vbattery     float
max_Vload        float
max_Vpv-0        float
max_Vpv-1        float
max_Pac-0        float
max___saved      integer
max_charge       float
max_Pbattery-0   float
max_eExport      float
max_eToday       float
max_Pload-0      float
max_temp         float
max_Ppv          float
min_Fac          float
min_Pac          float
min_Pbattery     float
min_Pload        float
max_VAac-0       float
min_Ppv-0        float
min_Ppv-1        float
max_Vac-0        float
min_VAac         float
min_Vac          float
max_Vbattery-0   float
min_Vbattery     float
min_Vload        float
max_Vload-0      float
min_Vpv-0        float
max_Vpv          float
min_Vpv-1        float
min___saved      integer
min_charge       float
min_eExport      float
max_battery_temp float
min_eToday       float
min_temp         float
min_Pac-0        float
min_Pbattery-0   float
min_Pload-0      float
min_Ppv          float
min_VAac-0       float
min_Vac-0        float
min_Vbattery-0   float
min_Vload-0      float
min_Vpv          float
min_battery_temp float

name: inverter
fieldKey        fieldType
--------        ---------
avg_Fac         float
avg_Pac         float
avg_Pac-0       float
avg_Ppv         float
avg_Pac-1       float
avg_Ppv-0       float
avg_Pac-2       float
avg_Ppv-1       float
avg_VAac        float
avg_VAac-0      float
avg_Vac         float
avg_Vac-0       float
avg_Vpv         float
avg_VAac-1      float
avg_Vpv-0       float
avg_VAac-2      float
avg_Vpv-1       float
avg___saved     float
avg_eExport     float
avg_Vac-1       float
avg_eImport     float
avg_Vac-2       float
avg_eToday      float
avg_powerFactor float
avg_temp        float
avg_timeTotal   float
avg_Vvac-0      float
max_Fac         float
max_Pac         float
max_Pac-0       float
max_Ppv         float
max_Ppv-0       float
max_Ppv-1       float
max_VAac        float
max_VAac-0      float
max_Vac         float
max_Vac-0       float
max_Vpv         float
max_Pac-1       float
max_Vpv-0       float
max_Pac-2       float
max_Vpv-1       float
max___saved     integer
max_eExport     float
max_eImport     float
max_eToday      float
max_powerFactor float
max_VAac-1      float
max_temp        float
max_VAac-2      float
max_timeTotal   float
min_Fac         float
min_Pac         float
max_Vac-1       float
min_Pac-0       float
max_Vac-2       float
min_Ppv         float
min_Ppv-0       float
min_Ppv-1       float
min_VAac        float
max_Vvac-0      float
min_VAac-0      float
min_Vac         float
min_Vac-0       float
min_Vpv         float
min_Vpv-0       float
min_Vpv-1       float
min___saved     integer
min_eExport     float
min_eImport     float
min_eToday      float
min_powerFactor float
min_Pac-1       float
min_temp        float
min_Pac-2       float
min_timeTotal   float
min_VAac-1      float
min_VAac-2      float
min_Vac-1       float
min_Vac-2       float
min_Vvac-0      float

name: usagemeter
fieldKey        fieldType
--------        ---------
avg_Fac         float
avg_Pac         float
avg_VAac        float
avg_Vac         float
avg___saved     float
avg_eExport     float
avg_eImport     float
avg_powerFactor float
max_Fac         float
max_Pac         float
max_VAac        float
max_Vac         float
max___saved     integer
max_eExport     float
max_eImport     float
max_powerFactor float
min_Fac         float
min_Pac         float
min_VAac        float
min_Vac         float
min___saved     integer
min_eExport     float
min_eImport     float
min_powerFactor float
avg_Pac-0       float
avg_Pac-1       float
avg_Pac-2       float
avg_VAac-0      float
avg_VAac-1      float
avg_VAac-2      float
avg_Vac-0       float
avg_Vac-1       float
avg_Vac-2       float
avg_eToday      float
avg_temp        float
avg_timeTotal   float
max_Pac-0       float
max_Pac-1       float
max_Pac-2       float
max_VAac-0      float
max_VAac-1      float
max_VAac-2      float
max_Vac-0       float
max_Vac-1       float
max_Vac-2       float
max_eToday      float
max_temp        float
max_timeTotal   float
min_Pac-0       float
min_Pac-1       float
min_Pac-2       float
min_VAac-0      float
min_VAac-1      float
min_VAac-2      float
min_Vac-0       float
min_Vac-1       float
min_Vac-2       float
min_eToday      float
min_temp        float
min_timeTotal   float

> exit

#8

Hi again, found something “interesting” today.
On a test system I blew away the databases and created new ones from scratch.
I then ran our application test scripts which generate test data as a side effect.
Noticing one of the test readings looked a little odd I decided to delete it rather than investigate further.

$ influx
> use solarmon_30min
Using database solarmon_30min
> select max_eToday from hybridinverter where __devhash='d224d82b6485682b01dd6cb0a32e06e3'
name: hybridinverter
time                 max_eToday
----                 ----------
2017-06-13T14:30:00Z 0
2017-06-13T15:00:00Z 0
2017-06-13T15:30:00Z 0
2017-06-13T16:00:00Z 0
2017-06-13T16:30:00Z 0
2017-06-13T17:00:00Z 0
2017-06-13T17:30:00Z 0
2017-06-13T18:00:00Z 0
2017-06-13T18:30:00Z 0
2017-06-13T19:00:00Z 0
2017-06-13T19:30:00Z 0
2017-06-13T20:00:00Z 0
2017-06-13T20:30:00Z 0
2017-06-13T21:00:00Z 0
2017-06-13T21:30:00Z 0.01
2017-06-13T22:00:00Z 0.049
2017-06-13T22:30:00Z 0.129
2017-06-13T23:00:00Z 0.261
2017-06-13T23:30:00Z 0.456
2017-06-14T00:00:00Z 0.723
2017-06-14T00:30:00Z 1.067
2017-06-14T01:00:00Z 1.493
2017-06-14T01:30:00Z 2.004
2017-06-14T02:00:00Z 2.599
2017-06-14T02:30:00Z 3.273
2017-06-14T03:00:00Z 4.022
2017-06-14T03:30:00Z 4.836
2017-06-14T04:00:00Z 5.705
2017-06-14T04:30:00Z 6.614
2017-06-14T05:00:00Z 7.549
2017-06-14T05:30:00Z 100
2017-06-14T06:00:00Z 9.424
2017-06-14T06:30:00Z 10.326
2017-06-14T07:00:00Z 11.179
2017-06-14T07:30:00Z 11.962
2017-06-14T08:00:00Z 12.657
2017-06-14T08:30:00Z 13.246
2017-06-14T09:00:00Z 13.712
2017-06-14T09:30:00Z 14.041
2017-06-14T10:00:00Z 14.222
2017-06-14T10:30:00Z 14.256
2017-06-14T11:00:00Z 14.256
2017-06-14T11:30:00Z 14.256
2017-06-14T12:00:00Z 14.256
2017-06-14T12:30:00Z 14.256
2017-06-14T13:00:00Z 14.256
2017-06-14T13:30:00Z 14.256
2017-06-14T14:00:00Z 14.256
2017-06-14T14:30:00Z 14.256

> delete from hybridinverter where __devhash='d224d82b6485682b01dd6cb0a32e06e3' and time='2017-06-14T05:30:00Z'
> select max_eToday from hybridinverter where __devhash='d224d82b6485682b01dd6cb0a32e06e3'
> select * from hybridinverter where __devhash='d224d82b6485682b01dd6cb0a32e06e3'
> show series
key
---
battery,__devhash=8362993999E2A72470D387229D90161D
battery,__devhash=888459402213AE55183E5BFE6BB8D503
batteryinverter,__devhash=4c821f6aab51154943d9f51fd3a7f172
inverter,__devhash=007c5959c50f3ddb1429dfc31e07033e
inverter,__devhash=6cfa0e50b62fe769fa04fc65b0068271
inverter,__devhash=7b8c79d3bd9074f4279e76abbbad0ee3
...

My delete from hybridinverter ... command has deleted the entire series, despite the fact it specified a single time stamp.

Is that expected behaviour? Note that many of those measurements are in the future (due to the way the test environment is set up) but I would still not expect a DELETE for a specific timestamp to delete everything.

Thanks,
Jeremy Begg


#9

FWIW, I have identified exactly what triggers the behaviour described in my previous comment, i.e. deleting a single measurement timepoint trashes the entire measurement series: the measurement point in question must be the first one added to the series, and must have a timestamp which is out of sequence with respect to the rest of the points in that series.

For example, I create the series by writing a measurement point at timestamp ‘100’ (just an example).
I then write more data points with timestamps starting at ‘1’ and increasing to (say) ‘200’, but not rewriting ‘100’, written in timestamp order.
I can delete any of those timestamps quite happily and the rest remain available. But if I delete the timestamp ‘100’ which was the first one written, the rest of the series disappears.

I haven’t checked to see what happens if I write a series with interleaved timestamps, e.g. write timepoints ‘10’, ‘20’, ‘30’ then ‘5’, ‘15’, ‘25’, ‘35’ but I’m inclined to suspect that deleting timepoint ‘20’ will result in a range of timepoints being deleted.

I notice that the release notes for InfluxDB version 1.2.3 have this comment, “Fix issue where deleted time field keys created unparseable points.” I will try this upgrade (we currently run 1.2.2) and see what happens.


#10

I have installed Influx 1.2.4 on my testbench and it looks like this may fix our problem with DELETE losing measurement data.