High CPU usage while idle every few hours for a few hours

1

Hey there

InfluxDB has somewhat high CPU usage while idle for a few hours a few times a day. This behaviour started yesterday.

12

This correlates somehwat with the “InfluxDB Memory Heap” Graph:

00
Screenshot 2019-01-27 at 15.40.00.png1394×513 95 KB

And with the “InfluxDB GC activity”,
24

What’s going on here, why did this start up all of a sudden and what can i do t stop it.
The only thing i did yesterday was dropping a small database.
I am running 1.7.3 on debian.

1 Like
2

It’s getting worse:

48

Edit:

There is a lot of this in the log, repeating over and over again:

2019-01-28T19:35:16.483486Z info TSM compaction (start) {“log_id”: “0DHV0IgW000”, “engine”: “tsm1”, “tsm1_level”: 1, “tsm1_strategy”: “level”, “trace_id”: “0DHVBJ0l000”, “op_name”: “tsm1_compact_group”, “op_event”: “start”}
2019-01-28T19:35:16.483658Z info Beginning compaction {“log_id”: “0DHV0IgW000”, “engine”: “tsm1”, “tsm1_level”: 1, “tsm1_strategy”: “level”, “trace_id”: “0DHVBJ0l000”, “op_name”: “tsm1_compact_group”, “tsm1_files_n”: 8}
2019-01-28T19:35:16.483748Z info Compacting file {“log_id”: “0DHV0IgW000”, “engine”: “tsm1”, “tsm1_level”: 1, “tsm1_strategy”: “level”, “trace_id”: “0DHVBJ0l000”, “op_name”: “tsm1_compact_group”, “tsm1_index”: 0, “tsm1_file”: “/mnt/influx/meta/data/telegraf/autogen/24/000000044-000000001.tsm”}
2019-01-28T19:35:16.483847Z info Compacting file {“log_id”: “0DHV0IgW000”, “engine”: “tsm1”, “tsm1_level”: 1, “tsm1_strategy”: “level”, “trace_id”: “0DHVBJ0l000”, “op_name”: “tsm1_compact_group”, “tsm1_index”: 1, “tsm1_file”: “/mnt/influx/meta/data/telegraf/autogen/24/000000045-000000001.tsm”}
2019-01-28T19:35:16.483941Z info Compacting file {“log_id”: “0DHV0IgW000”, “engine”: “tsm1”, “tsm1_level”: 1, “tsm1_strategy”: “level”, “trace_id”: “0DHVBJ0l000”, “op_name”: “tsm1_compact_group”, “tsm1_index”: 2, “tsm1_file”: “/mnt/influx/meta/data/telegraf/autogen/24/000000046-000000001.tsm”}
2019-01-28T19:35:16.484259Z info Compacting file {“log_id”: “0DHV0IgW000”, “engine”: “tsm1”, “tsm1_level”: 1, “tsm1_strategy”: “level”, “trace_id”: “0DHVBJ0l000”, “op_name”: “tsm1_compact_group”, “tsm1_index”: 3, “tsm1_file”: “/mnt/influx/meta/data/telegraf/autogen/24/000000047-000000001.tsm”}
2019-01-28T19:35:16.485254Z info Compacting file {“log_id”: “0DHV0IgW000”, “engine”: “tsm1”, “tsm1_level”: 1, “tsm1_strategy”: “level”, “trace_id”: “0DHVBJ0l000”, “op_name”: “tsm1_compact_group”, “tsm1_index”: 4, “tsm1_file”: “/mnt/influx/meta/data/telegraf/autogen/24/000000049-000000001.tsm”}
2019-01-28T19:35:16.485575Z info Compacting file {“log_id”: “0DHV0IgW000”, “engine”: “tsm1”, “tsm1_level”: 1, “tsm1_strategy”: “level”, “trace_id”: “0DHVBJ0l000”, “op_name”: “tsm1_compact_group”, “tsm1_index”: 5, “tsm1_file”: “/mnt/influx/meta/data/telegraf/autogen/24/000000051-000000001.tsm”}
2019-01-28T19:35:16.486418Z info Compacting file {“log_id”: “0DHV0IgW000”, “engine”: “tsm1”, “tsm1_level”: 1, “tsm1_strategy”: “level”, “trace_id”: “0DHVBJ0l000”, “op_name”: “tsm1_compact_group”, “tsm1_index”: 6, “tsm1_file”: “/mnt/influx/meta/data/telegraf/autogen/24/000000053-000000001.tsm”}
2019-01-28T19:35:16.487160Z info Compacting file {“log_id”: “0DHV0IgW000”, “engine”: “tsm1”, “tsm1_level”: 1, “tsm1_strategy”: “level”, “trace_id”: “0DHVBJ0l000”, “op_name”: “tsm1_compact_group”, “tsm1_index”: 7, “tsm1_file”: “/mnt/influx/meta/data/telegraf/autogen/24/000000055-000000001.tsm”}
2019-01-28T19:35:19.103643Z info Error compacting TSM files {“log_id”: “0DHV0IgW000”, “engine”: “tsm1”, “tsm1_level”: 1, “tsm1_strategy”: “level”, “trace_id”: “0DHVBJ0l000”, “op_name”: “tsm1_compact_group”, “error”: “EOF”}
2019-01-28T19:35:20.104037Z info TSM compaction (end) {“log_id”: “0DHV0IgW000”, “engine”: “tsm1”, “tsm1_level”: 1, “tsm1_strategy”: “level”, “trace_id”: “0DHVBJ0l000”, “op_name”: “tsm1_compact_group”, “op_event”: “end”, “op_elapsed”: “3620.546ms”}