Centos 7 server influxdb.service heavy load on server


#1

Hello,
i have centos 7 box & as soon as influxdb started on the box the load avg goes up & the grafana page does not show the graphs

service seems running 
● influxdb.service - InfluxDB is an open-source, distributed, time series database
   Loaded: loaded (/usr/lib/systemd/system/influxdb.service; enabled; vendor preset: disabled)
   Active: active (running) since Wed 2019-02-06 22:18:48 PST; 20min ago
     Docs: https://docs.influxdata.com/influxdb/
 Main PID: 10023 (influxd)
    Tasks: 44
   CGroup: /system.slice/influxdb.service
           └─10023 /usr/bin/influxd -config /etc/influxdb/influxdb.conf

var/log/messages have:

 influxd: ts=2019-02-07T06:40:17.058639Z lvl=info msg="Write failed" log_id=0DTeaFHG000 service=write shard=418 error="[shard 418] error opening memory map for file /var/lib/influxdb/data/telegraf/autogen/418/000010129-000000001.tsm: mmapAccessor: invalid indexStart"

influxd: ts=2019-02-07T06:39:55.218679Z lvl=error msg="[500] - \"timeout\"" log_id=0DTeaFHG000 service=httpd

i started & enable httpd & the load now coming down

But i still see:

influxd: ts=2019-02-07T06:59:32.763939Z lvl=error msg="[500] - \"[shard 418] error opening memory map for file /var/lib/influxdb/data/telegraf/autogen/418/000010129-000000001.tsm: mmapAccessor: invalid indexStart\"" log_id=0DTgpCfW000 service=httpd

And i do not see the graphs

I think influx db has gown & need trimming … i am not sure how to do that & how can i tell it to save 30 days data only say…

thanks


#2

i am running 1.5.2-1


#3

Hi @admink,

Your TSM file is corrupted. I believe the only thing you can do is remove the corrupted file:

rm /var/lib/influxdb/data/telegraf/autogen/418/000010129-000000001.tsm

influx_inspect dumptsm -dir /var/lib/influxdb may return some additional information, but unfortunately we cannot recover the corrupted file.