Hi,
I now have confirmation that InfluxDB has lost data.
A user contacted us to say he was looking at his charts last week and noticed there was no data showing for March, April or May this year (see attached). The chart he is looking is generated from aggregated data and I have been aware for a couple of weeks that there is a problem with aggregated data in this system, specifically for the period March, April and May. I was planning to rebuild the relevant database from the raw measurements, and assumed that this was just another example of that problem.
(In our system raw measurements get loaded into one database and then aggregated into 5- and 30-minute time intervals, into a separate database for each.)
The chart in the attached screenshot was generated on June 7 (we only received notice today, via a third party).
Investigating this problem today (June 13) the same chart shows NO data for January and February even though it is in the screen shot from last week.
Checking the raw (un-aggregated) and aggregated measurement data for this user I see no measurements prior to April 10 in the ‘raw’ database and nothing prior to May 31 in the two ‘aggregated’ databases. Yet we know for a fact that this user should have data going back to December last year.
Thinking this might be a case of in-memory index problems, I have done a clean shutdown of our application followed by a clean shutdown of Influx and then rebooted the server, but this did not bring any measurement data back.
I have now run influx_inspect
to dump the ‘raw’ measurement database for January and there are NO entries for this customer in the dump. (The dump is 17G in size and contains lots of other data.)
How can we diagnose this further to work out what is going on?
Thanks,
Jeremy Begg
I think more information on your configuration would be necessary to help diagnose, namely:
What is the duration configuration for your DBs?
Are you using CQ’s? If so, what is the configuration you have there?
Which version of influxdb are you running?
Here’s some more information about our setup.
We are running Influx 1.2.2 on Ubuntu Linux 16.04 LTS.
All three databases are set up with the default retention policy ‘autogen’, i.e. “infinite” retention.
The ‘raw’ measurements database, called “solarmon”, has the default 7-day shard duration.
The ‘aggregated’ measurement databases, called “solarmon_5min” and “solarmon_30min”, have 90-day shard duration.
We use both Continuous Queries and manual SELECT .. INTO
queries to populate the “solarmon_5min” and “solarmon_30min” databases. The CQs are:
> show continuous queries
name: _internal
name query
---- -----
name: solarmon
name query
---- -----
make_5min CREATE CONTINUOUS QUERY make_5min ON solarmon RESAMPLE EVERY 10m BEGIN SELECT mean(*) AS avg, max(*), min(*) INTO solarmon_5min.autogen.:MEASUREMENT FROM solarmon.autogen./.*/ GROUP BY time(5m), * END
make_30min CREATE CONTINUOUS QUERY make_30min ON solarmon RESAMPLE EVERY 1h BEGIN SELECT mean(*) AS avg, max(*), min(*) INTO solarmon_30min.autogen.:MEASUREMENT FROM solarmon.autogen./.*/ GROUP BY time(30m), * END
name: solarmon_5min
name query
---- -----
name: solarmon_30min
name query
---- -----
And the manual SELECT .. INTO
queries do almost the same thing, but with explicit measurement/tag values and time ranges.
My suspicion, based on watching data mysteriously disappearing from the aggregated databases and now from the raw database too, is that InfluxDB (TSM) is prone to losing data when applying updates over a wide time range. For example, back-filling the aggregated database for a series seems to randomly cause other series’ data to disappear. And now, with the raw measurement data, I know that several months’ worth of measurements were copied from one series to another and then the original series’ data deleted using DELETE FROM ...
and the “lost” data would have been in the same shards.
Thanks,
Jeremy Begg
jason
June 13, 2017, 4:42pm
4
Has the field type of your series changed between shards? If it changes, it can appear that the data is not there, but it’s just not being queried. For example, see New DB entry is causing all previous data to be lost? · Issue #8422 · influxdata/influxdb · GitHub .
Can you attach the output of show shards
as well as run show field keys
?
Hi Jason,
The fields are all floating-point numbers except for one which is an integer, and they are always numeric. (During initial testing on another system I have seen what happens when the type changes; typically the measurement is rejected by the HTTP service.)
The output of the commands will appear in successive replies.
(The web interface won’t let me include them in a single posting.)
Thanks
Jeremy Begg
Connected to http://localhost:8086 version 1.2.2
InfluxDB shell version: 1.2.2
> show shards
name: _internal
id database retention_policy shard_group start_time end_time expiry_time owners
-- -------- ---------------- ----------- ---------- -------- ----------- ------
635 _internal monitor 635 2017-06-06T00:00:00Z 2017-06-07T00:00:00Z 2017-06-14T00:00:00Z
636 _internal monitor 636 2017-06-07T00:00:00Z 2017-06-08T00:00:00Z 2017-06-15T00:00:00Z
637 _internal monitor 637 2017-06-08T00:00:00Z 2017-06-09T00:00:00Z 2017-06-16T00:00:00Z
638 _internal monitor 638 2017-06-09T00:00:00Z 2017-06-10T00:00:00Z 2017-06-17T00:00:00Z
639 _internal monitor 639 2017-06-10T00:00:00Z 2017-06-11T00:00:00Z 2017-06-18T00:00:00Z
640 _internal monitor 640 2017-06-11T00:00:00Z 2017-06-12T00:00:00Z 2017-06-19T00:00:00Z
641 _internal monitor 641 2017-06-12T00:00:00Z 2017-06-13T00:00:00Z 2017-06-20T00:00:00Z
643 _internal monitor 643 2017-06-13T00:00:00Z 2017-06-14T00:00:00Z 2017-06-21T00:00:00Z
649 _internal monitor 649 2017-06-14T00:00:00Z 2017-06-15T00:00:00Z 2017-06-22T00:00:00Z
name: solarmon
id database retention_policy shard_group start_time end_time expiry_time owners
-- -------- ---------------- ----------- ---------- -------- ----------- ------
613 solarmon autogen 613 2011-09-12T00:00:00Z 2011-09-19T00:00:00Z 2011-09-19T00:00:00Z
644 solarmon autogen 644 2012-12-31T00:00:00Z 2013-01-07T00:00:00Z 2013-01-07T00:00:00Z
647 solarmon autogen 647 2013-03-11T00:00:00Z 2013-03-18T00:00:00Z 2013-03-18T00:00:00Z
648 solarmon autogen 648 2013-03-18T00:00:00Z 2013-03-25T00:00:00Z 2013-03-25T00:00:00Z
349 solarmon autogen 349 2013-04-29T00:00:00Z 2013-05-06T00:00:00Z 2013-05-06T00:00:00Z
350 solarmon autogen 350 2013-05-06T00:00:00Z 2013-05-13T00:00:00Z 2013-05-13T00:00:00Z
351 solarmon autogen 351 2013-05-13T00:00:00Z 2013-05-20T00:00:00Z 2013-05-20T00:00:00Z
352 solarmon autogen 352 2013-05-20T00:00:00Z 2013-05-27T00:00:00Z 2013-05-27T00:00:00Z
353 solarmon autogen 353 2013-05-27T00:00:00Z 2013-06-03T00:00:00Z 2013-06-03T00:00:00Z
354 solarmon autogen 354 2013-06-03T00:00:00Z 2013-06-10T00:00:00Z 2013-06-10T00:00:00Z
355 solarmon autogen 355 2013-06-10T00:00:00Z 2013-06-17T00:00:00Z 2013-06-17T00:00:00Z
356 solarmon autogen 356 2013-06-17T00:00:00Z 2013-06-24T00:00:00Z 2013-06-24T00:00:00Z
357 solarmon autogen 357 2013-06-24T00:00:00Z 2013-07-01T00:00:00Z 2013-07-01T00:00:00Z
363 solarmon autogen 363 2013-07-01T00:00:00Z 2013-07-08T00:00:00Z 2013-07-08T00:00:00Z
364 solarmon autogen 364 2013-07-08T00:00:00Z 2013-07-15T00:00:00Z 2013-07-15T00:00:00Z
365 solarmon autogen 365 2013-07-15T00:00:00Z 2013-07-22T00:00:00Z 2013-07-22T00:00:00Z
366 solarmon autogen 366 2013-07-22T00:00:00Z 2013-07-29T00:00:00Z 2013-07-29T00:00:00Z
367 solarmon autogen 367 2013-07-29T00:00:00Z 2013-08-05T00:00:00Z 2013-08-05T00:00:00Z
362 solarmon autogen 362 2013-08-05T00:00:00Z 2013-08-12T00:00:00Z 2013-08-12T00:00:00Z
368 solarmon autogen 368 2013-08-12T00:00:00Z 2013-08-19T00:00:00Z 2013-08-19T00:00:00Z
373 solarmon autogen 373 2013-08-19T00:00:00Z 2013-08-26T00:00:00Z 2013-08-26T00:00:00Z
374 solarmon autogen 374 2013-08-26T00:00:00Z 2013-09-02T00:00:00Z 2013-09-02T00:00:00Z
375 solarmon autogen 375 2013-09-02T00:00:00Z 2013-09-09T00:00:00Z 2013-09-09T00:00:00Z
376 solarmon autogen 376 2013-09-09T00:00:00Z 2013-09-16T00:00:00Z 2013-09-16T00:00:00Z
377 solarmon autogen 377 2013-09-16T00:00:00Z 2013-09-23T00:00:00Z 2013-09-23T00:00:00Z
372 solarmon autogen 372 2013-09-23T00:00:00Z 2013-09-30T00:00:00Z 2013-09-30T00:00:00Z
371 solarmon autogen 371 2013-09-30T00:00:00Z 2013-10-07T00:00:00Z 2013-10-07T00:00:00Z
369 solarmon autogen 369 2013-10-07T00:00:00Z 2013-10-14T00:00:00Z 2013-10-14T00:00:00Z
370 solarmon autogen 370 2013-10-14T00:00:00Z 2013-10-21T00:00:00Z 2013-10-21T00:00:00Z
380 solarmon autogen 380 2013-10-21T00:00:00Z 2013-10-28T00:00:00Z 2013-10-28T00:00:00Z
381 solarmon autogen 381 2013-10-28T00:00:00Z 2013-11-04T00:00:00Z 2013-11-04T00:00:00Z
382 solarmon autogen 382 2013-11-04T00:00:00Z 2013-11-11T00:00:00Z 2013-11-11T00:00:00Z
383 solarmon autogen 383 2013-11-11T00:00:00Z 2013-11-18T00:00:00Z 2013-11-18T00:00:00Z
384 solarmon autogen 384 2013-11-18T00:00:00Z 2013-11-25T00:00:00Z 2013-11-25T00:00:00Z
385 solarmon autogen 385 2013-11-25T00:00:00Z 2013-12-02T00:00:00Z 2013-12-02T00:00:00Z
386 solarmon autogen 386 2013-12-02T00:00:00Z 2013-12-09T00:00:00Z 2013-12-09T00:00:00Z
387 solarmon autogen 387 2013-12-09T00:00:00Z 2013-12-16T00:00:00Z 2013-12-16T00:00:00Z
390 solarmon autogen 390 2013-12-16T00:00:00Z 2013-12-23T00:00:00Z 2013-12-23T00:00:00Z
393 solarmon autogen 393 2013-12-23T00:00:00Z 2013-12-30T00:00:00Z 2013-12-30T00:00:00Z
391 solarmon autogen 391 2013-12-30T00:00:00Z 2014-01-06T00:00:00Z 2014-01-06T00:00:00Z
392 solarmon autogen 392 2014-01-06T00:00:00Z 2014-01-13T00:00:00Z 2014-01-13T00:00:00Z
394 solarmon autogen 394 2014-01-13T00:00:00Z 2014-01-20T00:00:00Z 2014-01-20T00:00:00Z
395 solarmon autogen 395 2014-01-20T00:00:00Z 2014-01-27T00:00:00Z 2014-01-27T00:00:00Z
396 solarmon autogen 396 2014-01-27T00:00:00Z 2014-02-03T00:00:00Z 2014-02-03T00:00:00Z
397 solarmon autogen 397 2014-02-03T00:00:00Z 2014-02-10T00:00:00Z 2014-02-10T00:00:00Z
398 solarmon autogen 398 2014-02-10T00:00:00Z 2014-02-17T00:00:00Z 2014-02-17T00:00:00Z
399 solarmon autogen 399 2014-02-17T00:00:00Z 2014-02-24T00:00:00Z 2014-02-24T00:00:00Z
400 solarmon autogen 400 2014-02-24T00:00:00Z 2014-03-03T00:00:00Z 2014-03-03T00:00:00Z
401 solarmon autogen 401 2014-03-03T00:00:00Z 2014-03-10T00:00:00Z 2014-03-10T00:00:00Z
402 solarmon autogen 402 2014-03-10T00:00:00Z 2014-03-17T00:00:00Z 2014-03-17T00:00:00Z
405 solarmon autogen 405 2014-03-17T00:00:00Z 2014-03-24T00:00:00Z 2014-03-24T00:00:00Z
406 solarmon autogen 406 2014-03-24T00:00:00Z 2014-03-31T00:00:00Z 2014-03-31T00:00:00Z
407 solarmon autogen 407 2014-03-31T00:00:00Z 2014-04-07T00:00:00Z 2014-04-07T00:00:00Z
408 solarmon autogen 408 2014-04-07T00:00:00Z 2014-04-14T00:00:00Z 2014-04-14T00:00:00Z
409 solarmon autogen 409 2014-04-14T00:00:00Z 2014-04-21T00:00:00Z 2014-04-21T00:00:00Z
410 solarmon autogen 410 2014-04-21T00:00:00Z 2014-04-28T00:00:00Z 2014-04-28T00:00:00Z
411 solarmon autogen 411 2014-04-28T00:00:00Z 2014-05-05T00:00:00Z 2014-05-05T00:00:00Z
412 solarmon autogen 412 2014-05-05T00:00:00Z 2014-05-12T00:00:00Z 2014-05-12T00:00:00Z
413 solarmon autogen 413 2014-05-12T00:00:00Z 2014-05-19T00:00:00Z 2014-05-19T00:00:00Z
414 solarmon autogen 414 2014-05-19T00:00:00Z 2014-05-26T00:00:00Z 2014-05-26T00:00:00Z
415 solarmon autogen 415 2014-05-26T00:00:00Z 2014-06-02T00:00:00Z 2014-06-02T00:00:00Z
416 solarmon autogen 416 2014-06-02T00:00:00Z 2014-06-09T00:00:00Z 2014-06-09T00:00:00Z
417 solarmon autogen 417 2014-06-09T00:00:00Z 2014-06-16T00:00:00Z 2014-06-16T00:00:00Z
420 solarmon autogen 420 2014-06-16T00:00:00Z 2014-06-23T00:00:00Z 2014-06-23T00:00:00Z
421 solarmon autogen 421 2014-06-23T00:00:00Z 2014-06-30T00:00:00Z 2014-06-30T00:00:00Z
422 solarmon autogen 422 2014-06-30T00:00:00Z 2014-07-07T00:00:00Z 2014-07-07T00:00:00Z
423 solarmon autogen 423 2014-07-07T00:00:00Z 2014-07-14T00:00:00Z 2014-07-14T00:00:00Z
424 solarmon autogen 424 2014-07-14T00:00:00Z 2014-07-21T00:00:00Z 2014-07-21T00:00:00Z
425 solarmon autogen 425 2014-07-21T00:00:00Z 2014-07-28T00:00:00Z 2014-07-28T00:00:00Z
426 solarmon autogen 426 2014-07-28T00:00:00Z 2014-08-04T00:00:00Z 2014-08-04T00:00:00Z
427 solarmon autogen 427 2014-08-04T00:00:00Z 2014-08-11T00:00:00Z 2014-08-11T00:00:00Z
428 solarmon autogen 428 2014-08-11T00:00:00Z 2014-08-18T00:00:00Z 2014-08-18T00:00:00Z
429 solarmon autogen 429 2014-08-18T00:00:00Z 2014-08-25T00:00:00Z 2014-08-25T00:00:00Z
430 solarmon autogen 430 2014-08-25T00:00:00Z 2014-09-01T00:00:00Z 2014-09-01T00:00:00Z
431 solarmon autogen 431 2014-09-01T00:00:00Z 2014-09-08T00:00:00Z 2014-09-08T00:00:00Z
434 solarmon autogen 434 2014-09-08T00:00:00Z 2014-09-15T00:00:00Z 2014-09-15T00:00:00Z
435 solarmon autogen 435 2014-09-15T00:00:00Z 2014-09-22T00:00:00Z 2014-09-22T00:00:00Z
436 solarmon autogen 436 2014-09-22T00:00:00Z 2014-09-29T00:00:00Z 2014-09-29T00:00:00Z
437 solarmon autogen 437 2014-09-29T00:00:00Z 2014-10-06T00:00:00Z 2014-10-06T00:00:00Z
438 solarmon autogen 438 2014-10-06T00:00:00Z 2014-10-13T00:00:00Z 2014-10-13T00:00:00Z
439 solarmon autogen 439 2014-10-13T00:00:00Z 2014-10-20T00:00:00Z 2014-10-20T00:00:00Z
440 solarmon autogen 440 2014-10-20T00:00:00Z 2014-10-27T00:00:00Z 2014-10-27T00:00:00Z
441 solarmon autogen 441 2014-10-27T00:00:00Z 2014-11-03T00:00:00Z 2014-11-03T00:00:00Z
442 solarmon autogen 442 2014-11-03T00:00:00Z 2014-11-10T00:00:00Z 2014-11-10T00:00:00Z
443 solarmon autogen 443 2014-11-10T00:00:00Z 2014-11-17T00:00:00Z 2014-11-17T00:00:00Z
444 solarmon autogen 444 2014-11-17T00:00:00Z 2014-11-24T00:00:00Z 2014-11-24T00:00:00Z
445 solarmon autogen 445 2014-11-24T00:00:00Z 2014-12-01T00:00:00Z 2014-12-01T00:00:00Z
446 solarmon autogen 446 2014-12-01T00:00:00Z 2014-12-08T00:00:00Z 2014-12-08T00:00:00Z
449 solarmon autogen 449 2014-12-08T00:00:00Z 2014-12-15T00:00:00Z 2014-12-15T00:00:00Z
450 solarmon autogen 450 2014-12-15T00:00:00Z 2014-12-22T00:00:00Z 2014-12-22T00:00:00Z
451 solarmon autogen 451 2014-12-22T00:00:00Z 2014-12-29T00:00:00Z 2014-12-29T00:00:00Z
452 solarmon autogen 452 2014-12-29T00:00:00Z 2015-01-05T00:00:00Z 2015-01-05T00:00:00Z
454 solarmon autogen 454 2015-01-05T00:00:00Z 2015-01-12T00:00:00Z 2015-01-12T00:00:00Z
455 solarmon autogen 455 2015-01-12T00:00:00Z 2015-01-19T00:00:00Z 2015-01-19T00:00:00Z
456 solarmon autogen 456 2015-01-19T00:00:00Z 2015-01-26T00:00:00Z 2015-01-26T00:00:00Z
457 solarmon autogen 457 2015-01-26T00:00:00Z 2015-02-02T00:00:00Z 2015-02-02T00:00:00Z
458 solarmon autogen 458 2015-02-02T00:00:00Z 2015-02-09T00:00:00Z 2015-02-09T00:00:00Z
459 solarmon autogen 459 2015-02-09T00:00:00Z 2015-02-16T00:00:00Z 2015-02-16T00:00:00Z
460 solarmon autogen 460 2015-02-16T00:00:00Z 2015-02-23T00:00:00Z 2015-02-23T00:00:00Z
461 solarmon autogen 461 2015-02-23T00:00:00Z 2015-03-02T00:00:00Z 2015-03-02T00:00:00Z
462 solarmon autogen 462 2015-03-02T00:00:00Z 2015-03-09T00:00:00Z 2015-03-09T00:00:00Z
465 solarmon autogen 465 2015-03-09T00:00:00Z 2015-03-16T00:00:00Z 2015-03-16T00:00:00Z
466 solarmon autogen 466 2015-03-16T00:00:00Z 2015-03-23T00:00:00Z 2015-03-23T00:00:00Z
467 solarmon autogen 467 2015-03-23T00:00:00Z 2015-03-30T00:00:00Z 2015-03-30T00:00:00Z
468 solarmon autogen 468 2015-03-30T00:00:00Z 2015-04-06T00:00:00Z 2015-04-06T00:00:00Z
469 solarmon autogen 469 2015-04-06T00:00:00Z 2015-04-13T00:00:00Z 2015-04-13T00:00:00Z
470 solarmon autogen 470 2015-04-13T00:00:00Z 2015-04-20T00:00:00Z 2015-04-20T00:00:00Z
471 solarmon autogen 471 2015-04-20T00:00:00Z 2015-04-27T00:00:00Z 2015-04-27T00:00:00Z
472 solarmon autogen 472 2015-04-27T00:00:00Z 2015-05-04T00:00:00Z 2015-05-04T00:00:00Z
473 solarmon autogen 473 2015-05-04T00:00:00Z 2015-05-11T00:00:00Z 2015-05-11T00:00:00Z
474 solarmon autogen 474 2015-05-11T00:00:00Z 2015-05-18T00:00:00Z 2015-05-18T00:00:00Z
475 solarmon autogen 475 2015-05-18T00:00:00Z 2015-05-25T00:00:00Z 2015-05-25T00:00:00Z
476 solarmon autogen 476 2015-05-25T00:00:00Z 2015-06-01T00:00:00Z 2015-06-01T00:00:00Z
477 solarmon autogen 477 2015-06-01T00:00:00Z 2015-06-08T00:00:00Z 2015-06-08T00:00:00Z
480 solarmon autogen 480 2015-06-08T00:00:00Z 2015-06-15T00:00:00Z 2015-06-15T00:00:00Z
481 solarmon autogen 481 2015-06-15T00:00:00Z 2015-06-22T00:00:00Z 2015-06-22T00:00:00Z
482 solarmon autogen 482 2015-06-22T00:00:00Z 2015-06-29T00:00:00Z 2015-06-29T00:00:00Z
483 solarmon autogen 483 2015-06-29T00:00:00Z 2015-07-06T00:00:00Z 2015-07-06T00:00:00Z
484 solarmon autogen 484 2015-07-06T00:00:00Z 2015-07-13T00:00:00Z 2015-07-13T00:00:00Z
485 solarmon autogen 485 2015-07-13T00:00:00Z 2015-07-20T00:00:00Z 2015-07-20T00:00:00Z
486 solarmon autogen 486 2015-07-20T00:00:00Z 2015-07-27T00:00:00Z 2015-07-27T00:00:00Z
487 solarmon autogen 487 2015-07-27T00:00:00Z 2015-08-03T00:00:00Z 2015-08-03T00:00:00Z
488 solarmon autogen 488 2015-08-03T00:00:00Z 2015-08-10T00:00:00Z 2015-08-10T00:00:00Z
489 solarmon autogen 489 2015-08-10T00:00:00Z 2015-08-17T00:00:00Z 2015-08-17T00:00:00Z
490 solarmon autogen 490 2015-08-17T00:00:00Z 2015-08-24T00:00:00Z 2015-08-24T00:00:00Z
491 solarmon autogen 491 2015-08-24T00:00:00Z 2015-08-31T00:00:00Z 2015-08-31T00:00:00Z
492 solarmon autogen 492 2015-08-31T00:00:00Z 2015-09-07T00:00:00Z 2015-09-07T00:00:00Z
495 solarmon autogen 495 2015-09-07T00:00:00Z 2015-09-14T00:00:00Z 2015-09-14T00:00:00Z
496 solarmon autogen 496 2015-09-14T00:00:00Z 2015-09-21T00:00:00Z 2015-09-21T00:00:00Z
497 solarmon autogen 497 2015-09-21T00:00:00Z 2015-09-28T00:00:00Z 2015-09-28T00:00:00Z
498 solarmon autogen 498 2015-09-28T00:00:00Z 2015-10-05T00:00:00Z 2015-10-05T00:00:00Z
499 solarmon autogen 499 2015-10-05T00:00:00Z 2015-10-12T00:00:00Z 2015-10-12T00:00:00Z
500 solarmon autogen 500 2015-10-12T00:00:00Z 2015-10-19T00:00:00Z 2015-10-19T00:00:00Z
501 solarmon autogen 501 2015-10-19T00:00:00Z 2015-10-26T00:00:00Z 2015-10-26T00:00:00Z
502 solarmon autogen 502 2015-10-26T00:00:00Z 2015-11-02T00:00:00Z 2015-11-02T00:00:00Z
503 solarmon autogen 503 2015-11-02T00:00:00Z 2015-11-09T00:00:00Z 2015-11-09T00:00:00Z
504 solarmon autogen 504 2015-11-09T00:00:00Z 2015-11-16T00:00:00Z 2015-11-16T00:00:00Z
505 solarmon autogen 505 2015-11-16T00:00:00Z 2015-11-23T00:00:00Z 2015-11-23T00:00:00Z
506 solarmon autogen 506 2015-11-23T00:00:00Z 2015-11-30T00:00:00Z 2015-11-30T00:00:00Z
509 solarmon autogen 509 2015-11-30T00:00:00Z 2015-12-07T00:00:00Z 2015-12-07T00:00:00Z
510 solarmon autogen 510 2015-12-07T00:00:00Z 2015-12-14T00:00:00Z 2015-12-14T00:00:00Z
511 solarmon autogen 511 2015-12-14T00:00:00Z 2015-12-21T00:00:00Z 2015-12-21T00:00:00Z
512 solarmon autogen 512 2015-12-21T00:00:00Z 2015-12-28T00:00:00Z 2015-12-28T00:00:00Z
513 solarmon autogen 513 2015-12-28T00:00:00Z 2016-01-04T00:00:00Z 2016-01-04T00:00:00Z
515 solarmon autogen 515 2016-01-04T00:00:00Z 2016-01-11T00:00:00Z 2016-01-11T00:00:00Z
516 solarmon autogen 516 2016-01-11T00:00:00Z 2016-01-18T00:00:00Z 2016-01-18T00:00:00Z
517 solarmon autogen 517 2016-01-18T00:00:00Z 2016-01-25T00:00:00Z 2016-01-25T00:00:00Z
518 solarmon autogen 518 2016-01-25T00:00:00Z 2016-02-01T00:00:00Z 2016-02-01T00:00:00Z
519 solarmon autogen 519 2016-02-01T00:00:00Z 2016-02-08T00:00:00Z 2016-02-08T00:00:00Z
520 solarmon autogen 520 2016-02-08T00:00:00Z 2016-02-15T00:00:00Z 2016-02-15T00:00:00Z
521 solarmon autogen 521 2016-02-15T00:00:00Z 2016-02-22T00:00:00Z 2016-02-22T00:00:00Z
522 solarmon autogen 522 2016-02-22T00:00:00Z 2016-02-29T00:00:00Z 2016-02-29T00:00:00Z
525 solarmon autogen 525 2016-02-29T00:00:00Z 2016-03-07T00:00:00Z 2016-03-07T00:00:00Z
526 solarmon autogen 526 2016-03-07T00:00:00Z 2016-03-14T00:00:00Z 2016-03-14T00:00:00Z
527 solarmon autogen 527 2016-03-14T00:00:00Z 2016-03-21T00:00:00Z 2016-03-21T00:00:00Z
528 solarmon autogen 528 2016-03-21T00:00:00Z 2016-03-28T00:00:00Z 2016-03-28T00:00:00Z
529 solarmon autogen 529 2016-03-28T00:00:00Z 2016-04-04T00:00:00Z 2016-04-04T00:00:00Z
530 solarmon autogen 530 2016-04-04T00:00:00Z 2016-04-11T00:00:00Z 2016-04-11T00:00:00Z
531 solarmon autogen 531 2016-04-11T00:00:00Z 2016-04-18T00:00:00Z 2016-04-18T00:00:00Z
532 solarmon autogen 532 2016-04-18T00:00:00Z 2016-04-25T00:00:00Z 2016-04-25T00:00:00Z
533 solarmon autogen 533 2016-04-25T00:00:00Z 2016-05-02T00:00:00Z 2016-05-02T00:00:00Z
534 solarmon autogen 534 2016-05-02T00:00:00Z 2016-05-09T00:00:00Z 2016-05-09T00:00:00Z
535 solarmon autogen 535 2016-05-09T00:00:00Z 2016-05-16T00:00:00Z 2016-05-16T00:00:00Z
536 solarmon autogen 536 2016-05-16T00:00:00Z 2016-05-23T00:00:00Z 2016-05-23T00:00:00Z
537 solarmon autogen 537 2016-05-23T00:00:00Z 2016-05-30T00:00:00Z 2016-05-30T00:00:00Z
540 solarmon autogen 540 2016-05-30T00:00:00Z 2016-06-06T00:00:00Z 2016-06-06T00:00:00Z
541 solarmon autogen 541 2016-06-06T00:00:00Z 2016-06-13T00:00:00Z 2016-06-13T00:00:00Z
542 solarmon autogen 542 2016-06-13T00:00:00Z 2016-06-20T00:00:00Z 2016-06-20T00:00:00Z
543 solarmon autogen 543 2016-06-20T00:00:00Z 2016-06-27T00:00:00Z 2016-06-27T00:00:00Z
545 solarmon autogen 545 2016-06-27T00:00:00Z 2016-07-04T00:00:00Z 2016-07-04T00:00:00Z
546 solarmon autogen 546 2016-07-04T00:00:00Z 2016-07-11T00:00:00Z 2016-07-11T00:00:00Z
547 solarmon autogen 547 2016-07-11T00:00:00Z 2016-07-18T00:00:00Z 2016-07-18T00:00:00Z
548 solarmon autogen 548 2016-07-18T00:00:00Z 2016-07-25T00:00:00Z 2016-07-25T00:00:00Z
549 solarmon autogen 549 2016-07-25T00:00:00Z 2016-08-01T00:00:00Z 2016-08-01T00:00:00Z
550 solarmon autogen 550 2016-08-01T00:00:00Z 2016-08-08T00:00:00Z 2016-08-08T00:00:00Z
551 solarmon autogen 551 2016-08-08T00:00:00Z 2016-08-15T00:00:00Z 2016-08-15T00:00:00Z
552 solarmon autogen 552 2016-08-15T00:00:00Z 2016-08-22T00:00:00Z 2016-08-22T00:00:00Z
553 solarmon autogen 553 2016-08-22T00:00:00Z 2016-08-29T00:00:00Z 2016-08-29T00:00:00Z
556 solarmon autogen 556 2016-08-29T00:00:00Z 2016-09-05T00:00:00Z 2016-09-05T00:00:00Z
557 solarmon autogen 557 2016-09-05T00:00:00Z 2016-09-12T00:00:00Z 2016-09-12T00:00:00Z
558 solarmon autogen 558 2016-09-12T00:00:00Z 2016-09-19T00:00:00Z 2016-09-19T00:00:00Z
559 solarmon autogen 559 2016-09-19T00:00:00Z 2016-09-26T00:00:00Z 2016-09-26T00:00:00Z
560 solarmon autogen 560 2016-09-26T00:00:00Z 2016-10-03T00:00:00Z 2016-10-03T00:00:00Z
561 solarmon autogen 561 2016-10-03T00:00:00Z 2016-10-10T00:00:00Z 2016-10-10T00:00:00Z
562 solarmon autogen 562 2016-10-10T00:00:00Z 2016-10-17T00:00:00Z 2016-10-17T00:00:00Z
563 solarmon autogen 563 2016-10-17T00:00:00Z 2016-10-24T00:00:00Z 2016-10-24T00:00:00Z
564 solarmon autogen 564 2016-10-24T00:00:00Z 2016-10-31T00:00:00Z 2016-10-31T00:00:00Z
565 solarmon autogen 565 2016-10-31T00:00:00Z 2016-11-07T00:00:00Z 2016-11-07T00:00:00Z
566 solarmon autogen 566 2016-11-07T00:00:00Z 2016-11-14T00:00:00Z 2016-11-14T00:00:00Z
567 solarmon autogen 567 2016-11-14T00:00:00Z 2016-11-21T00:00:00Z 2016-11-21T00:00:00Z
568 solarmon autogen 568 2016-11-21T00:00:00Z 2016-11-28T00:00:00Z 2016-11-28T00:00:00Z
571 solarmon autogen 571 2016-11-28T00:00:00Z 2016-12-05T00:00:00Z 2016-12-05T00:00:00Z
572 solarmon autogen 572 2016-12-05T00:00:00Z 2016-12-12T00:00:00Z 2016-12-12T00:00:00Z
573 solarmon autogen 573 2016-12-12T00:00:00Z 2016-12-19T00:00:00Z 2016-12-19T00:00:00Z
574 solarmon autogen 574 2016-12-19T00:00:00Z 2016-12-26T00:00:00Z 2016-12-26T00:00:00Z
575 solarmon autogen 575 2016-12-26T00:00:00Z 2017-01-02T00:00:00Z 2017-01-02T00:00:00Z
577 solarmon autogen 577 2017-01-02T00:00:00Z 2017-01-09T00:00:00Z 2017-01-09T00:00:00Z
578 solarmon autogen 578 2017-01-09T00:00:00Z 2017-01-16T00:00:00Z 2017-01-16T00:00:00Z
579 solarmon autogen 579 2017-01-16T00:00:00Z 2017-01-23T00:00:00Z 2017-01-23T00:00:00Z
580 solarmon autogen 580 2017-01-23T00:00:00Z 2017-01-30T00:00:00Z 2017-01-30T00:00:00Z
581 solarmon autogen 581 2017-01-30T00:00:00Z 2017-02-06T00:00:00Z 2017-02-06T00:00:00Z
582 solarmon autogen 582 2017-02-06T00:00:00Z 2017-02-13T00:00:00Z 2017-02-13T00:00:00Z
583 solarmon autogen 583 2017-02-13T00:00:00Z 2017-02-20T00:00:00Z 2017-02-20T00:00:00Z
584 solarmon autogen 584 2017-02-20T00:00:00Z 2017-02-27T00:00:00Z 2017-02-27T00:00:00Z
587 solarmon autogen 587 2017-02-27T00:00:00Z 2017-03-06T00:00:00Z 2017-03-06T00:00:00Z
588 solarmon autogen 588 2017-03-06T00:00:00Z 2017-03-13T00:00:00Z 2017-03-13T00:00:00Z
589 solarmon autogen 589 2017-03-13T00:00:00Z 2017-03-20T00:00:00Z 2017-03-20T00:00:00Z
590 solarmon autogen 590 2017-03-20T00:00:00Z 2017-03-27T00:00:00Z 2017-03-27T00:00:00Z
591 solarmon autogen 591 2017-03-27T00:00:00Z 2017-04-03T00:00:00Z 2017-04-03T00:00:00Z
592 solarmon autogen 592 2017-04-03T00:00:00Z 2017-04-10T00:00:00Z 2017-04-10T00:00:00Z
593 solarmon autogen 593 2017-04-10T00:00:00Z 2017-04-17T00:00:00Z 2017-04-17T00:00:00Z
594 solarmon autogen 594 2017-04-17T00:00:00Z 2017-04-24T00:00:00Z 2017-04-24T00:00:00Z
595 solarmon autogen 595 2017-04-24T00:00:00Z 2017-05-01T00:00:00Z 2017-05-01T00:00:00Z
596 solarmon autogen 596 2017-05-01T00:00:00Z 2017-05-08T00:00:00Z 2017-05-08T00:00:00Z
597 solarmon autogen 597 2017-05-08T00:00:00Z 2017-05-15T00:00:00Z 2017-05-15T00:00:00Z
601 solarmon autogen 601 2017-05-15T00:00:00Z 2017-05-22T00:00:00Z 2017-05-22T00:00:00Z
619 solarmon autogen 619 2017-05-22T00:00:00Z 2017-05-29T00:00:00Z 2017-05-29T00:00:00Z
605 solarmon autogen 605 2017-05-29T00:00:00Z 2017-06-05T00:00:00Z 2017-06-05T00:00:00Z
634 solarmon autogen 634 2017-06-05T00:00:00Z 2017-06-12T00:00:00Z 2017-06-12T00:00:00Z
642 solarmon autogen 642 2017-06-12T00:00:00Z 2017-06-19T00:00:00Z 2017-06-19T00:00:00Z
604 solarmon autogen 604 2017-09-18T00:00:00Z 2017-09-25T00:00:00Z 2017-09-25T00:00:00Z
603 solarmon autogen 603 2017-10-09T00:00:00Z 2017-10-16T00:00:00Z 2017-10-16T00:00:00Z
name: solarmon_5min
id database retention_policy shard_group start_time end_time expiry_time owners
-- -------- ---------------- ----------- ---------- -------- ----------- ------
615 solarmon_5min autogen 615 2011-06-23T00:00:00Z 2011-09-21T00:00:00Z 2011-09-21T00:00:00Z
646 solarmon_5min autogen 646 2012-12-14T00:00:00Z 2013-03-14T00:00:00Z 2013-03-14T00:00:00Z
360 solarmon_5min autogen 360 2013-03-14T00:00:00Z 2013-06-12T00:00:00Z 2013-06-12T00:00:00Z
361 solarmon_5min autogen 361 2013-06-12T00:00:00Z 2013-09-10T00:00:00Z 2013-09-10T00:00:00Z
379 solarmon_5min autogen 379 2013-09-10T00:00:00Z 2013-12-09T00:00:00Z 2013-12-09T00:00:00Z
389 solarmon_5min autogen 389 2013-12-09T00:00:00Z 2014-03-09T00:00:00Z 2014-03-09T00:00:00Z
404 solarmon_5min autogen 404 2014-03-09T00:00:00Z 2014-06-07T00:00:00Z 2014-06-07T00:00:00Z
419 solarmon_5min autogen 419 2014-06-07T00:00:00Z 2014-09-05T00:00:00Z 2014-09-05T00:00:00Z
433 solarmon_5min autogen 433 2014-09-05T00:00:00Z 2014-12-04T00:00:00Z 2014-12-04T00:00:00Z
448 solarmon_5min autogen 448 2014-12-04T00:00:00Z 2015-03-04T00:00:00Z 2015-03-04T00:00:00Z
464 solarmon_5min autogen 464 2015-03-04T00:00:00Z 2015-06-02T00:00:00Z 2015-06-02T00:00:00Z
479 solarmon_5min autogen 479 2015-06-02T00:00:00Z 2015-08-31T00:00:00Z 2015-08-31T00:00:00Z
494 solarmon_5min autogen 494 2015-08-31T00:00:00Z 2015-11-29T00:00:00Z 2015-11-29T00:00:00Z
508 solarmon_5min autogen 508 2015-11-29T00:00:00Z 2016-02-27T00:00:00Z 2016-02-27T00:00:00Z
524 solarmon_5min autogen 524 2016-02-27T00:00:00Z 2016-05-27T00:00:00Z 2016-05-27T00:00:00Z
539 solarmon_5min autogen 539 2016-05-27T00:00:00Z 2016-08-25T00:00:00Z 2016-08-25T00:00:00Z
555 solarmon_5min autogen 555 2016-08-25T00:00:00Z 2016-11-23T00:00:00Z 2016-11-23T00:00:00Z
570 solarmon_5min autogen 570 2016-11-23T00:00:00Z 2017-02-21T00:00:00Z 2017-02-21T00:00:00Z
586 solarmon_5min autogen 586 2017-02-21T00:00:00Z 2017-05-22T00:00:00Z 2017-05-22T00:00:00Z
609 solarmon_5min autogen 609 2017-05-22T00:00:00Z 2017-08-20T00:00:00Z 2017-08-20T00:00:00Z
607 solarmon_5min autogen 607 2017-08-20T00:00:00Z 2017-11-18T00:00:00Z 2017-11-18T00:00:00Z
name: solarmon_30min
id database retention_policy shard_group start_time end_time expiry_time owners
-- -------- ---------------- ----------- ---------- -------- ----------- ------
614 solarmon_30min autogen 614 2011-06-23T00:00:00Z 2011-09-21T00:00:00Z 2011-09-21T00:00:00Z
645 solarmon_30min autogen 645 2012-12-14T00:00:00Z 2013-03-14T00:00:00Z 2013-03-14T00:00:00Z
358 solarmon_30min autogen 358 2013-03-14T00:00:00Z 2013-06-12T00:00:00Z 2013-06-12T00:00:00Z
359 solarmon_30min autogen 359 2013-06-12T00:00:00Z 2013-09-10T00:00:00Z 2013-09-10T00:00:00Z
378 solarmon_30min autogen 378 2013-09-10T00:00:00Z 2013-12-09T00:00:00Z 2013-12-09T00:00:00Z
388 solarmon_30min autogen 388 2013-12-09T00:00:00Z 2014-03-09T00:00:00Z 2014-03-09T00:00:00Z
403 solarmon_30min autogen 403 2014-03-09T00:00:00Z 2014-06-07T00:00:00Z 2014-06-07T00:00:00Z
418 solarmon_30min autogen 418 2014-06-07T00:00:00Z 2014-09-05T00:00:00Z 2014-09-05T00:00:00Z
432 solarmon_30min autogen 432 2014-09-05T00:00:00Z 2014-12-04T00:00:00Z 2014-12-04T00:00:00Z
447 solarmon_30min autogen 447 2014-12-04T00:00:00Z 2015-03-04T00:00:00Z 2015-03-04T00:00:00Z
463 solarmon_30min autogen 463 2015-03-04T00:00:00Z 2015-06-02T00:00:00Z 2015-06-02T00:00:00Z
478 solarmon_30min autogen 478 2015-06-02T00:00:00Z 2015-08-31T00:00:00Z 2015-08-31T00:00:00Z
493 solarmon_30min autogen 493 2015-08-31T00:00:00Z 2015-11-29T00:00:00Z 2015-11-29T00:00:00Z
507 solarmon_30min autogen 507 2015-11-29T00:00:00Z 2016-02-27T00:00:00Z 2016-02-27T00:00:00Z
523 solarmon_30min autogen 523 2016-02-27T00:00:00Z 2016-05-27T00:00:00Z 2016-05-27T00:00:00Z
538 solarmon_30min autogen 538 2016-05-27T00:00:00Z 2016-08-25T00:00:00Z 2016-08-25T00:00:00Z
554 solarmon_30min autogen 554 2016-08-25T00:00:00Z 2016-11-23T00:00:00Z 2016-11-23T00:00:00Z
569 solarmon_30min autogen 569 2016-11-23T00:00:00Z 2017-02-21T00:00:00Z 2017-02-21T00:00:00Z
585 solarmon_30min autogen 585 2017-02-21T00:00:00Z 2017-05-22T00:00:00Z 2017-05-22T00:00:00Z
608 solarmon_30min autogen 608 2017-05-22T00:00:00Z 2017-08-20T00:00:00Z 2017-08-20T00:00:00Z
606 solarmon_30min autogen 606 2017-08-20T00:00:00Z 2017-11-18T00:00:00Z 2017-11-18T00:00:00Z
> exit
Connected to http://localhost:8086 version 1.2.2
InfluxDB shell version: 1.2.2
> use solarmon
Using database solarmon
> show field keys
name: battery
fieldKey fieldType
-------- ---------
Abattery float
Fac float
Pac float
Pac-0 float
VAac float
Pdc float
VAac-0 float
Vac float
Vac-0 float
VCmax float
__saved integer
VCmin float
chargeKWh float
eExport float
eImport float
Vbattery float
eToday float
Vdc float
powerFactor float
temp float
charge float
timeTotal float
name: batteryinverter
fieldKey fieldType
-------- ---------
Fac float
Pac float
Pbattery float
Pdc float
Pload float
VAac float
Vac float
Vbattery float
Vdc float
__saved integer
charge float
temp float
name: hybridinverter
fieldKey fieldType
-------- ---------
Fac float
Pac float
Pac-0 float
Pbattery float
Pload float
Pbattery-0 float
Ppv-0 float
Ppv-1 float
Pload-0 float
VAac float
Ppv float
Vac float
Vbattery float
Vload float
Vpv-0 float
VAac-0 float
Vpv-1 float
__saved integer
Vac-0 float
charge float
eExport float
Vbattery-0 float
eToday float
temp float
Vload-0 float
Vpv float
battery_temp float
name: inverter
fieldKey fieldType
-------- ---------
Fac float
Pac float
Ppv float
Pac-0 float
Ppv-0 float
Pac-1 float
Ppv-1 float
Pac-2 float
VAac float
Vac float
Vpv float
Vpv-0 float
Vpv-1 float
VAac-0 float
__saved integer
VAac-1 float
eExport float
VAac-2 float
eImport float
eToday float
Vac-0 float
powerFactor float
Vac-1 float
temp float
Vac-2 float
timeTotal float
Vvac-0 float
name: usagemeter
fieldKey fieldType
-------- ---------
Fac float
Pac float
Pac-0 float
VAac float
Pac-1 float
Vac float
Pac-2 float
__saved integer
eExport float
VAac-0 float
eImport float
VAac-1 float
powerFactor float
VAac-2 float
Vac-0 float
Vac-1 float
Vac-2 float
eToday float
temp float
timeTotal float
> use solarmon_5min
Using database solarmon_5min
> show field keys
name: battery
fieldKey fieldType
-------- ---------
avg_Fac float
avg_Abattery float
avg_Pac float
avg_VAac float
avg_Vac float
avg_Pac-0 float
avg___saved float
avg_Pdc float
avg_chargeKWh float
avg_VAac-0 float
avg_eExport float
avg_VCmax float
avg_eImport float
avg_VCmin float
avg_powerFactor float
max_Fac float
avg_Vac-0 float
max_Pac float
avg_Vbattery float
max_VAac float
max_Vac float
avg_Vdc float
avg_charge float
max___saved integer
max_chargeKWh float
max_eExport float
max_eImport float
avg_eToday float
max_powerFactor float
min_Fac float
avg_temp float
min_Pac float
avg_timeTotal float
min_VAac float
max_Abattery float
min_Vac float
min___saved integer
min_chargeKWh float
max_Pac-0 float
min_eExport float
min_eImport float
max_VAac-0 float
min_powerFactor float
max_Pdc float
max_VCmax float
max_VCmin float
max_Vac-0 float
max_Vbattery float
max_charge float
max_Vdc float
max_eToday float
max_temp float
max_timeTotal float
min_Abattery float
min_Pac-0 float
min_VAac-0 float
min_VCmax float
min_VCmin float
min_Pdc float
min_Vac-0 float
min_Vbattery float
min_charge float
min_Vdc float
min_eToday float
min_temp float
min_timeTotal float
name: batteryinverter
fieldKey fieldType
-------- ---------
avg_Fac float
avg_Pac float
avg_Pbattery float
avg_Pdc float
avg_Pload float
avg_VAac float
avg_Vac float
avg_Vbattery float
avg_Vdc float
avg___saved float
avg_charge float
avg_temp float
max_Fac float
max_Pac float
max_Pbattery float
max_Pdc float
max_Pload float
max_VAac float
max_Vac float
max_Vbattery float
max_Vdc float
max___saved integer
max_charge float
max_temp float
min_Fac float
min_Pac float
min_Pbattery float
min_Pdc float
min_Pload float
min_VAac float
min_Vac float
min_Vbattery float
min_Vdc float
min___saved integer
min_charge float
min_temp float
name: hybridinverter
fieldKey fieldType
-------- ---------
avg_Fac float
avg_Pac float
avg_Pac-0 float
avg_Pbattery float
avg_Pload float
avg_Pbattery-0 float
avg_Ppv-0 float
avg_Ppv-1 float
avg_Pload-0 float
avg_VAac float
avg_Ppv float
avg_Vac float
avg_Vbattery float
avg_Vload float
avg_Vpv-0 float
avg_VAac-0 float
avg_Vpv-1 float
avg___saved float
avg_Vac-0 float
avg_charge float
avg_eExport float
avg_Vbattery-0 float
avg_eToday float
avg_temp float
avg_Vload-0 float
max_Fac float
avg_Vpv float
max_Pac float
max_Pbattery float
max_Pload float
max_Ppv-0 float
avg_battery_temp float
max_Ppv-1 float
max_VAac float
max_Vac float
max_Vbattery float
max_Vload float
max_Vpv-0 float
max_Vpv-1 float
max_Pac-0 float
max___saved integer
max_charge float
max_Pbattery-0 float
max_eExport float
max_eToday float
max_Pload-0 float
max_temp float
max_Ppv float
min_Fac float
min_Pac float
min_Pbattery float
min_Pload float
max_VAac-0 float
min_Ppv-0 float
min_Ppv-1 float
max_Vac-0 float
min_VAac float
min_Vac float
max_Vbattery-0 float
min_Vbattery float
min_Vload float
max_Vload-0 float
min_Vpv-0 float
max_Vpv float
min_Vpv-1 float
min___saved integer
min_charge float
min_eExport float
max_battery_temp float
min_eToday float
min_temp float
min_Pac-0 float
min_Pbattery-0 float
min_Pload-0 float
min_Ppv float
min_VAac-0 float
min_Vac-0 float
min_Vbattery-0 float
min_Vload-0 float
min_Vpv float
min_battery_temp float
name: inverter
fieldKey fieldType
-------- ---------
avg_Fac float
avg_Pac float
avg_Pac-0 float
avg_Ppv float
avg_Pac-1 float
avg_Ppv-0 float
avg_Pac-2 float
avg_Ppv-1 float
avg_VAac float
avg_VAac-0 float
avg_Vac float
avg_Vac-0 float
avg_Vpv float
avg_VAac-1 float
avg_Vpv-0 float
avg_VAac-2 float
avg_Vpv-1 float
avg___saved float
avg_eExport float
avg_Vac-1 float
avg_eImport float
avg_Vac-2 float
avg_eToday float
avg_powerFactor float
avg_temp float
avg_timeTotal float
avg_Vvac-0 float
max_Fac float
max_Pac float
max_Pac-0 float
max_Ppv float
max_Ppv-0 float
max_Ppv-1 float
max_VAac float
max_VAac-0 float
max_Vac float
max_Vac-0 float
max_Vpv float
max_Pac-1 float
max_Vpv-0 float
max_Pac-2 float
max_Vpv-1 float
max___saved integer
max_eExport float
max_eImport float
max_eToday float
max_powerFactor float
max_VAac-1 float
max_temp float
max_VAac-2 float
max_timeTotal float
min_Fac float
min_Pac float
max_Vac-1 float
min_Pac-0 float
max_Vac-2 float
min_Ppv float
min_Ppv-0 float
min_Ppv-1 float
min_VAac float
max_Vvac-0 float
min_VAac-0 float
min_Vac float
min_Vac-0 float
min_Vpv float
min_Vpv-0 float
min_Vpv-1 float
min___saved integer
min_eExport float
min_eImport float
min_eToday float
min_powerFactor float
min_Pac-1 float
min_temp float
min_Pac-2 float
min_timeTotal float
min_VAac-1 float
min_VAac-2 float
min_Vac-1 float
min_Vac-2 float
min_Vvac-0 float
name: usagemeter
fieldKey fieldType
-------- ---------
avg_Fac float
avg_Pac float
avg_VAac float
avg_Vac float
avg___saved float
avg_eExport float
avg_eImport float
avg_powerFactor float
max_Fac float
max_Pac float
max_VAac float
max_Vac float
max___saved integer
max_eExport float
max_eImport float
max_powerFactor float
min_Fac float
min_Pac float
min_VAac float
min_Vac float
min___saved integer
min_eExport float
min_eImport float
min_powerFactor float
avg_Pac-0 float
avg_Pac-1 float
avg_Pac-2 float
avg_VAac-0 float
avg_VAac-1 float
avg_VAac-2 float
avg_Vac-0 float
avg_Vac-1 float
avg_Vac-2 float
avg_eToday float
avg_temp float
avg_timeTotal float
max_Pac-0 float
max_Pac-1 float
max_Pac-2 float
max_VAac-0 float
max_VAac-1 float
max_VAac-2 float
max_Vac-0 float
max_Vac-1 float
max_Vac-2 float
max_eToday float
max_temp float
max_timeTotal float
min_Pac-0 float
min_Pac-1 float
min_Pac-2 float
min_VAac-0 float
min_VAac-1 float
min_VAac-2 float
min_Vac-0 float
min_Vac-1 float
min_Vac-2 float
min_eToday float
min_temp float
min_timeTotal float
> use solarmon_30min
Using database solarmon_30min
> show field keys
name: battery
fieldKey fieldType
-------- ---------
avg_Fac float
avg_Abattery float
avg_Pac float
avg_VAac float
avg_Vac float
avg_Pac-0 float
avg___saved float
avg_Pdc float
avg_chargeKWh float
avg_VAac-0 float
avg_eExport float
avg_VCmax float
avg_eImport float
avg_VCmin float
avg_powerFactor float
max_Fac float
avg_Vac-0 float
max_Pac float
avg_Vbattery float
max_VAac float
max_Vac float
avg_Vdc float
avg_charge float
max___saved integer
max_chargeKWh float
max_eExport float
max_eImport float
avg_eToday float
max_powerFactor float
min_Fac float
avg_temp float
min_Pac float
avg_timeTotal float
min_VAac float
max_Abattery float
min_Vac float
min___saved integer
min_chargeKWh float
max_Pac-0 float
min_eExport float
min_eImport float
max_VAac-0 float
min_powerFactor float
max_Pdc float
max_VCmax float
max_VCmin float
max_Vac-0 float
max_Vbattery float
max_charge float
max_Vdc float
max_eToday float
max_temp float
max_timeTotal float
min_Abattery float
min_Pac-0 float
min_VAac-0 float
min_VCmax float
min_VCmin float
min_Pdc float
min_Vac-0 float
min_Vbattery float
min_charge float
min_Vdc float
min_eToday float
min_temp float
min_timeTotal float
name: batteryinverter
fieldKey fieldType
-------- ---------
avg_Fac float
avg_Pac float
avg_Pbattery float
avg_Pdc float
avg_Pload float
avg_VAac float
avg_Vac float
avg_Vbattery float
avg_Vdc float
avg___saved float
avg_charge float
avg_temp float
max_Fac float
max_Pac float
max_Pbattery float
max_Pdc float
max_Pload float
max_VAac float
max_Vac float
max_Vbattery float
max_Vdc float
max___saved integer
max_charge float
max_temp float
min_Fac float
min_Pac float
min_Pbattery float
min_Pdc float
min_Pload float
min_VAac float
min_Vac float
min_Vbattery float
min_Vdc float
min___saved integer
min_charge float
min_temp float
name: hybridinverter
fieldKey fieldType
-------- ---------
avg_Fac float
avg_Pac float
avg_Pac-0 float
avg_Pbattery float
avg_Pload float
avg_Pbattery-0 float
avg_Ppv-0 float
avg_Ppv-1 float
avg_Pload-0 float
avg_VAac float
avg_Ppv float
avg_Vac float
avg_Vbattery float
avg_Vload float
avg_Vpv-0 float
avg_VAac-0 float
avg_Vpv-1 float
avg___saved float
avg_Vac-0 float
avg_charge float
avg_eExport float
avg_Vbattery-0 float
avg_eToday float
avg_temp float
avg_Vload-0 float
max_Fac float
avg_Vpv float
max_Pac float
max_Pbattery float
max_Pload float
max_Ppv-0 float
avg_battery_temp float
max_Ppv-1 float
max_VAac float
max_Vac float
max_Vbattery float
max_Vload float
max_Vpv-0 float
max_Vpv-1 float
max_Pac-0 float
max___saved integer
max_charge float
max_Pbattery-0 float
max_eExport float
max_eToday float
max_Pload-0 float
max_temp float
max_Ppv float
min_Fac float
min_Pac float
min_Pbattery float
min_Pload float
max_VAac-0 float
min_Ppv-0 float
min_Ppv-1 float
max_Vac-0 float
min_VAac float
min_Vac float
max_Vbattery-0 float
min_Vbattery float
min_Vload float
max_Vload-0 float
min_Vpv-0 float
max_Vpv float
min_Vpv-1 float
min___saved integer
min_charge float
min_eExport float
max_battery_temp float
min_eToday float
min_temp float
min_Pac-0 float
min_Pbattery-0 float
min_Pload-0 float
min_Ppv float
min_VAac-0 float
min_Vac-0 float
min_Vbattery-0 float
min_Vload-0 float
min_Vpv float
min_battery_temp float
name: inverter
fieldKey fieldType
-------- ---------
avg_Fac float
avg_Pac float
avg_Pac-0 float
avg_Ppv float
avg_Pac-1 float
avg_Ppv-0 float
avg_Pac-2 float
avg_Ppv-1 float
avg_VAac float
avg_VAac-0 float
avg_Vac float
avg_Vac-0 float
avg_Vpv float
avg_VAac-1 float
avg_Vpv-0 float
avg_VAac-2 float
avg_Vpv-1 float
avg___saved float
avg_eExport float
avg_Vac-1 float
avg_eImport float
avg_Vac-2 float
avg_eToday float
avg_powerFactor float
avg_temp float
avg_timeTotal float
avg_Vvac-0 float
max_Fac float
max_Pac float
max_Pac-0 float
max_Ppv float
max_Ppv-0 float
max_Ppv-1 float
max_VAac float
max_VAac-0 float
max_Vac float
max_Vac-0 float
max_Vpv float
max_Pac-1 float
max_Vpv-0 float
max_Pac-2 float
max_Vpv-1 float
max___saved integer
max_eExport float
max_eImport float
max_eToday float
max_powerFactor float
max_VAac-1 float
max_temp float
max_VAac-2 float
max_timeTotal float
min_Fac float
min_Pac float
max_Vac-1 float
min_Pac-0 float
max_Vac-2 float
min_Ppv float
min_Ppv-0 float
min_Ppv-1 float
min_VAac float
max_Vvac-0 float
min_VAac-0 float
min_Vac float
min_Vac-0 float
min_Vpv float
min_Vpv-0 float
min_Vpv-1 float
min___saved integer
min_eExport float
min_eImport float
min_eToday float
min_powerFactor float
min_Pac-1 float
min_temp float
min_Pac-2 float
min_timeTotal float
min_VAac-1 float
min_VAac-2 float
min_Vac-1 float
min_Vac-2 float
min_Vvac-0 float
name: usagemeter
fieldKey fieldType
-------- ---------
avg_Fac float
avg_Pac float
avg_VAac float
avg_Vac float
avg___saved float
avg_eExport float
avg_eImport float
avg_powerFactor float
max_Fac float
max_Pac float
max_VAac float
max_Vac float
max___saved integer
max_eExport float
max_eImport float
max_powerFactor float
min_Fac float
min_Pac float
min_VAac float
min_Vac float
min___saved integer
min_eExport float
min_eImport float
min_powerFactor float
avg_Pac-0 float
avg_Pac-1 float
avg_Pac-2 float
avg_VAac-0 float
avg_VAac-1 float
avg_VAac-2 float
avg_Vac-0 float
avg_Vac-1 float
avg_Vac-2 float
avg_eToday float
avg_temp float
avg_timeTotal float
max_Pac-0 float
max_Pac-1 float
max_Pac-2 float
max_VAac-0 float
max_VAac-1 float
max_VAac-2 float
max_Vac-0 float
max_Vac-1 float
max_Vac-2 float
max_eToday float
max_temp float
max_timeTotal float
min_Pac-0 float
min_Pac-1 float
min_Pac-2 float
min_VAac-0 float
min_VAac-1 float
min_VAac-2 float
min_Vac-0 float
min_Vac-1 float
min_Vac-2 float
min_eToday float
min_temp float
min_timeTotal float
> exit
Hi again, found something “interesting” today.
On a test system I blew away the databases and created new ones from scratch.
I then ran our application test scripts which generate test data as a side effect.
Noticing one of the test readings looked a little odd I decided to delete it rather than investigate further.
$ influx
> use solarmon_30min
Using database solarmon_30min
> select max_eToday from hybridinverter where __devhash='d224d82b6485682b01dd6cb0a32e06e3'
name: hybridinverter
time max_eToday
---- ----------
2017-06-13T14:30:00Z 0
2017-06-13T15:00:00Z 0
2017-06-13T15:30:00Z 0
2017-06-13T16:00:00Z 0
2017-06-13T16:30:00Z 0
2017-06-13T17:00:00Z 0
2017-06-13T17:30:00Z 0
2017-06-13T18:00:00Z 0
2017-06-13T18:30:00Z 0
2017-06-13T19:00:00Z 0
2017-06-13T19:30:00Z 0
2017-06-13T20:00:00Z 0
2017-06-13T20:30:00Z 0
2017-06-13T21:00:00Z 0
2017-06-13T21:30:00Z 0.01
2017-06-13T22:00:00Z 0.049
2017-06-13T22:30:00Z 0.129
2017-06-13T23:00:00Z 0.261
2017-06-13T23:30:00Z 0.456
2017-06-14T00:00:00Z 0.723
2017-06-14T00:30:00Z 1.067
2017-06-14T01:00:00Z 1.493
2017-06-14T01:30:00Z 2.004
2017-06-14T02:00:00Z 2.599
2017-06-14T02:30:00Z 3.273
2017-06-14T03:00:00Z 4.022
2017-06-14T03:30:00Z 4.836
2017-06-14T04:00:00Z 5.705
2017-06-14T04:30:00Z 6.614
2017-06-14T05:00:00Z 7.549
2017-06-14T05:30:00Z 100
2017-06-14T06:00:00Z 9.424
2017-06-14T06:30:00Z 10.326
2017-06-14T07:00:00Z 11.179
2017-06-14T07:30:00Z 11.962
2017-06-14T08:00:00Z 12.657
2017-06-14T08:30:00Z 13.246
2017-06-14T09:00:00Z 13.712
2017-06-14T09:30:00Z 14.041
2017-06-14T10:00:00Z 14.222
2017-06-14T10:30:00Z 14.256
2017-06-14T11:00:00Z 14.256
2017-06-14T11:30:00Z 14.256
2017-06-14T12:00:00Z 14.256
2017-06-14T12:30:00Z 14.256
2017-06-14T13:00:00Z 14.256
2017-06-14T13:30:00Z 14.256
2017-06-14T14:00:00Z 14.256
2017-06-14T14:30:00Z 14.256
> delete from hybridinverter where __devhash='d224d82b6485682b01dd6cb0a32e06e3' and time='2017-06-14T05:30:00Z'
> select max_eToday from hybridinverter where __devhash='d224d82b6485682b01dd6cb0a32e06e3'
> select * from hybridinverter where __devhash='d224d82b6485682b01dd6cb0a32e06e3'
> show series
key
---
battery,__devhash=8362993999E2A72470D387229D90161D
battery,__devhash=888459402213AE55183E5BFE6BB8D503
batteryinverter,__devhash=4c821f6aab51154943d9f51fd3a7f172
inverter,__devhash=007c5959c50f3ddb1429dfc31e07033e
inverter,__devhash=6cfa0e50b62fe769fa04fc65b0068271
inverter,__devhash=7b8c79d3bd9074f4279e76abbbad0ee3
...
My delete from hybridinverter ...
command has deleted the entire series, despite the fact it specified a single time stamp.
Is that expected behaviour? Note that many of those measurements are in the future (due to the way the test environment is set up) but I would still not expect a DELETE for a specific timestamp to delete everything.
Thanks,
Jeremy Begg
FWIW, I have identified exactly what triggers the behaviour described in my previous comment, i.e. deleting a single measurement timepoint trashes the entire measurement series: the measurement point in question must be the first one added to the series, and must have a timestamp which is out of sequence with respect to the rest of the points in that series.
For example, I create the series by writing a measurement point at timestamp ‘100’ (just an example).
I then write more data points with timestamps starting at ‘1’ and increasing to (say) ‘200’, but not rewriting ‘100’, written in timestamp order.
I can delete any of those timestamps quite happily and the rest remain available. But if I delete the timestamp ‘100’ which was the first one written, the rest of the series disappears.
I haven’t checked to see what happens if I write a series with interleaved timestamps, e.g. write timepoints ‘10’, ‘20’, ‘30’ then ‘5’, ‘15’, ‘25’, ‘35’ but I’m inclined to suspect that deleting timepoint ‘20’ will result in a range of timepoints being deleted.
I notice that the release notes for InfluxDB version 1.2.3 have this comment, “Fix issue where deleted time field keys created unparseable points.” I will try this upgrade (we currently run 1.2.2) and see what happens.
I have installed Influx 1.2.4 on my testbench and it looks like this may fix our problem with DELETE losing measurement data.
1 Like