My InfluxDB was working fine for 2-3 months, but now it all a sudden has become unresponsive.
Any idea what could be causing this?
pi@raspberrypi:~ $ influx
Failed to connect to http://localhost:8086: Get http://localhost:8086/ping: dial tcp [::1]:8086: connect: connection refused
Please check your connection settings and ensure 'influxd' is running.
pi@raspberrypi:~ $ sudo systemctl restart influxdb
pi@raspberrypi:~ $ influx
Connected to http://localhost:8086 version 1.8.10
InfluxDB shell version: 1.8.10
> show databases
name: databases
name
----
_internal
patience
collectd_db
> show databases
ERR: Post http://localhost:8086/query?chunked=true&db=&epoch=ns&q=show+databases: dial tcp [::1]:8086: connect: connection refused
>
pi@raspberrypi:~ $ influx
Connected to http://localhost:8086 version 1.8.10
InfluxDB shell version: 1.8.10
> show databases
ERR: Post http://localhost:8086/query?chunked=true&db=&epoch=ns&q=show+databases: dial tcp [::1]:8086: connect: connection refused
> exit
pi@raspberrypi:~ $ sudo systemctl restart influxdb
pi@raspberrypi:~ $ influx
Failed to connect to http://localhost:8086: Get http://localhost:8086/ping: dial tcp [::1]:8086: connect: connection refused
Please check your connection settings and ensure 'influxd' is running.
pi@raspberrypi:~ $
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17394]: /go/src/github.com/influxdata/influxdb/tsdb/engine/tsm1/engine.go:2178 +0xf4
May 09 14:29:21 raspberrypi systemd[1]: influxdb.service: Main process exited, code=exited, status=2/INVALIDARGUMENT
May 09 14:29:21 raspberrypi systemd[1]: influxdb.service: Failed with result 'exit-code'.
May 09 14:29:21 raspberrypi systemd[1]: influxdb.service: Consumed 1min 3.006s CPU time.
May 09 14:29:21 raspberrypi systemd[1]: influxdb.service: Scheduled restart job, restart counter is at 158.
May 09 14:29:21 raspberrypi systemd[1]: Stopped InfluxDB is an open-source, distributed, time series database.
May 09 14:29:21 raspberrypi systemd[1]: influxdb.service: Consumed 1min 3.006s CPU time.
May 09 14:29:21 raspberrypi systemd[1]: Starting InfluxDB is an open-source, distributed, time series database...
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17477]: Merging with configuration at: /etc/influxdb/influxdb.conf
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17475]: ts=2022-05-09T18:29:21.704455Z lvl=info msg="InfluxDB starting" log_id=0aMXAbf0000 version=1.8.10 branch=1.8 commit=688e697c51fd
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17475]: ts=2022-05-09T18:29:21.704545Z lvl=info msg="Go runtime" log_id=0aMXAbf0000 version=go1.13.8 maxprocs=4
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17494]: Merging with configuration at: /etc/influxdb/influxdb.conf
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17474]: InfluxDB API unavailable after 1 attempts...
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17475]: ts=2022-05-09T18:29:21.806056Z lvl=info msg="Using data dir" log_id=0aMXAbf0000 service=store path=/var/lib/influxdb/data
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17475]: ts=2022-05-09T18:29:21.806151Z lvl=info msg="Compaction settings" log_id=0aMXAbf0000 service=store max_concurrent_compactions=2 throughput_bytes_p>
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17475]: ts=2022-05-09T18:29:21.806198Z lvl=info msg="Open store (start)" log_id=0aMXAbf0000 service=store trace_id=0aMXAc3W000 op_name=tsdb_open op_event=>
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17475]: ts=2022-05-09T18:29:21.817960Z lvl=info msg="Opened file" log_id=0aMXAbf0000 engine=tsm1 service=filestore path=/var/lib/influxdb/data/_internal/m>
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17475]: ts=2022-05-09T18:29:21.817786Z lvl=info msg="Opened file" log_id=0aMXAbf0000 engine=tsm1 service=filestore path=/var/lib/influxdb/data/_internal/m>
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17475]: ts=2022-05-09T18:29:21.819420Z lvl=info msg="Opened file" log_id=0aMXAbf0000 engine=tsm1 service=filestore path=/var/lib/influxdb/data/_internal/m>
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17475]: ts=2022-05-09T18:29:21.824969Z lvl=info msg="Opened file" log_id=0aMXAbf0000 engine=tsm1 service=filestore path=/var/lib/influxdb/data/_internal/m>
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17475]: ts=2022-05-09T18:29:21.851961Z lvl=info msg="Opened shard" log_id=0aMXAbf0000 service=store trace_id=0aMXAc3W000 op_name=tsdb_open index_version=i>
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17475]: ts=2022-05-09T18:29:21.853383Z lvl=info msg="Opened shard" log_id=0aMXAbf0000 service=store trace_id=0aMXAc3W000 op_name=tsdb_open index_version=i>
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17475]: ts=2022-05-09T18:29:21.853612Z lvl=info msg="Reading file" log_id=0aMXAbf0000 engine=tsm1 service=cacheloader path=/var/lib/influxdb/wal/_internal>
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17475]: ts=2022-05-09T18:29:21.856112Z lvl=info msg="Opened shard" log_id=0aMXAbf0000 service=store trace_id=0aMXAc3W000 op_name=tsdb_open index_version=i>
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17475]: ts=2022-05-09T18:29:21.858260Z lvl=info msg="Opened file" log_id=0aMXAbf0000 engine=tsm1 service=filestore path=/var/lib/influxdb/data/_internal/m>
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17475]: ts=2022-05-09T18:29:21.858551Z lvl=info msg="Opened shard" log_id=0aMXAbf0000 service=store trace_id=0aMXAc3W000 op_name=tsdb_open index_version=i>
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17475]: ts=2022-05-09T18:29:21.862190Z lvl=info msg="Opened file" log_id=0aMXAbf0000 engine=tsm1 service=filestore path=/var/lib/influxdb/data/_internal/m>
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17475]: ts=2022-05-09T18:29:21.863025Z lvl=info msg="Reading file" log_id=0aMXAbf0000 engine=tsm1 service=cacheloader path=/var/lib/influxdb/wal/_internal>
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17475]: ts=2022-05-09T18:29:21.862629Z lvl=info msg="Opened file" log_id=0aMXAbf0000 engine=tsm1 service=filestore path=/var/lib/influxdb/data/_internal/m>
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17475]: ts=2022-05-09T18:29:21.880428Z lvl=info msg="Opened shard" log_id=0aMXAbf0000 service=store trace_id=0aMXAc3W000 op_name=tsdb_open index_version=i>
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17475]: ts=2022-05-09T18:29:21.885474Z lvl=info msg="Opened file" log_id=0aMXAbf0000 engine=tsm1 service=filestore path=/var/lib/influxdb/data/_internal/m>
May 09 14:29:21 raspberrypi influxd-systemd-start.sh[17475]: ts=2022-05-09T18:29:21.894010Z lvl=info msg="Opened shard" log_id=0aMXAbf0000 service=store trace_id=0aMXAc3W000 op_name=tsdb_open index_version=i>
It looks like the shards are fine…
pi@raspberrypi:/var/lib/influxdb/data $ sudo influx_inspect verify -dir /var/lib/influxdb/
/var/lib/influxdb/data/_internal/monitor/132/000000015-000000002.tsm: healthy
/var/lib/influxdb/data/_internal/monitor/133/000000013-000000002.tsm: healthy
...
/var/lib/influxdb/data/patience/autogen/94/000000048-000000002.tsm: healthy
/var/lib/influxdb/data/patience/autogen/94/000000064-000000001.tsm: healthy
Broken Blocks: 0 / 587279, in 45.153180827s
