Upgrade to 1.5 fails with authentication enabled

nextrama · March 21, 2018, 2:43am

I have two servers one is dev the other prod which are running influxdb 1.4.2 just fine on Centos7.4.

I was able to upgrade influx on the dev box via yum and it ran fine, but when the same procedure was done of the prod box the upgrade worked, but starting influx gave the ‘generic’ socket can’t connect error:
Failed to connect to http://localhost:8086: Get http://localhost:8086/ping: dial tcp [::1]:8086: getsockopt: connection refused

So had to downgrade the influxdb to get things working for now.

The only difference between the machines is that authentication is turned on in the production box.

Tried:

turning authentication off
setting the IP address with the --host flag

So where to from here?

mark · March 21, 2018, 3:14pm

What do the influxdb logs say on the prod machine?

nextrama · March 21, 2018, 11:42pm

Nothing useful g maybe i should be logging something else besides the defaults? Although I did notice that i hadn’t re-enabled authentication so that’s good.

Anyway snippets of the logs for each version are below

influx 1.50
#logs from 1.5 influxdb (authentication=false)
Mar 21 12:22:05 scarlet.bom.gov.au systemd[1]: Started InfluxDB is an open-source, distributed, time series database.
Mar 21 12:22:05 scarlet.bom.gov.au systemd[1]: Starting InfluxDB is an open-source, distributed, time series database…
Mar 21 12:22:05 scarlet.bom.gov.au influxd[1154]: ts=2018-03-21T01:22:05.259335Z lvl=info msg=“InfluxDB starting” log_id=06yYD~Il000 version=1.5.0 branch=1.5 commit=6ac835404e7e64ea7299a6eebcce1ab1ef15fe3c
Mar 21 12:22:05 scarlet.bom.gov.au influxd[1154]: ts=2018-03-21T01:22:05.259357Z lvl=info msg=“Go runtime” log_id=06yYD~Il000 version=go1.9.2 maxprocs=8
Mar 21 12:22:05 scarlet.bom.gov.au influxd[1154]: ts=2018-03-21T01:22:05.361325Z lvl=info msg=“Using data dir” log_id=06yYD~Il000 service=store path=/home/influxdb/data
Mar 21 12:22:05 scarlet.bom.gov.au influxd[1154]: ts=2018-03-21T01:22:05.361832Z lvl=info msg=“Open store (start)” log_id=06yYD~Il000 service=store trace_id=06yYD~hG000 op_name=tsdb_open op_event=start
Mar 21 12:22:06 scarlet.bom.gov.au influxd[1154]: ts=2018-03-21T01:22:06.305847Z lvl=info msg=“Opened file” log_id=06yYD~Il000 engine=tsm1 service=filestore path=/home/influxdb/data/_internal/monitor/1441/000000040-000000001.tsm id=3 duration=897.936ms
Mar 21 12:22:06 scarlet.bom.gov.au influxd[1154]: ts=2018-03-21T01:22:06.392954Z lvl=info msg=“Opened file” log_id=06yYD~Il000 engine=tsm1 service=filestore path=/home/influxdb/data/_internal/monitor/1436/000000960-000000005.tsm id=0 duration=983.287ms
Mar 21 12:22:06 scarlet.bom.gov.au influxd[1154]: ts=2018-03-21T01:22:06.398388Z lvl=info msg=“Opened file” log_id=06yYD~Il000 engine=tsm1 service=filestore path=/home/influxdb/data/_internal/monitor/1435/000000960-000000005.tsm id=0 duration=989.852ms
Mar 21 12:22:06 scarlet.bom.gov.au influxd[1154]: ts=2018-03-21T01:22:06.406555Z lvl=info msg=“Opened file” log_id=06yYD~Il000 engine=tsm1 service=filestore path=/home/influxdb/data/_internal/monitor/1433/000000960-000000005.tsm id=0 duration=998.541ms
Mar 21 12:22:06 scarlet.bom.gov.au influxd[1154]: ts=2018-03-21T01:22:06.407232Z lvl=info msg=“Opened file” log_id=06yYD~Il000 engine=tsm1 service=filestore path=/home/influxdb/data/_internal/monitor/1441/000000032-000000005.tsm id=0 duration=428.284ms
Mar 21 12:22:06 scarlet.bom.gov.au influxd[1154]: ts=2018-03-21T01:22:06.414520Z lvl=info msg=“Opened file” log_id=06yYD~Il000 engine=tsm1 service=filestore path=/home/influxdb/data/_internal/monitor/1441/000000038-000000002.tsm id=2 duration=419.487ms
Mar 21 12:22:06 scarlet.bom.gov.au influxd[1154]: ts=2018-03-21T01:22:06.417491Z lvl=info msg=“Opened file” log_id=06yYD~Il000 engine=tsm1 service=filestore path=/home/influxdb/data/_internal/monitor/1432/000000960-000000005.tsm id=0 duration=1007.611ms
Mar 21 12:22:06 scarlet.bom.gov.au influxd[1154]: ts=2018-03-21T01:22:06.421581Z lvl=info msg=“Opened file” log_id=06yYD~Il000 engine=tsm1 service=filestore path=/home/influxdb/data/_internal/monitor/1440/000000960-000000005.tsm id=0 duration=304.808ms

...

Mar 21 12:32:01 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:01.869639Z lvl=info msg="Opened shard" log_id=06yYTVo0000 service=store trace_id=06yYTWD0000 op_name=tsdb_open path=/home/influxdb/data/solar_network/autogen/765 duration=262.492ms
Mar 21 12:32:01 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:01.935874Z lvl=info msg="Open store (end)" log_id=06yYTVo0000 service=store trace_id=06yYTWD0000 op_name=tsdb_open op_event=end op_elapsed=342491.674ms
Mar 21 12:32:01 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:01.936317Z lvl=info msg="Opened service" log_id=06yYTVo0000 service=subscriber
Mar 21 12:32:01 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:01.936753Z lvl=info msg="Starting monitor service" log_id=06yYTVo0000 service=monitor
Mar 21 12:32:01 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:01.938177Z lvl=info msg="Registered diagnostics client" log_id=06yYTVo0000 service=monitor name=build
Mar 21 12:32:01 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:01.938970Z lvl=info msg="Registered diagnostics client" log_id=06yYTVo0000 service=monitor name=runtime
Mar 21 12:32:01 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:01.938984Z lvl=info msg="Registered diagnostics client" log_id=06yYTVo0000 service=monitor name=network
Mar 21 12:32:01 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:01.939008Z lvl=info msg="Registered diagnostics client" log_id=06yYTVo0000 service=monitor name=system
Mar 21 12:32:01 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:01.939088Z lvl=info msg="Starting precreation service" log_id=06yYTVo0000 service=shard-precreation check_interval=10m advance_period=30m
Mar 21 12:32:01 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:01.939101Z lvl=info msg="Starting snapshot service" log_id=06yYTVo0000 service=snapshot
Mar 21 12:32:01 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:01.939106Z lvl=info msg="Starting continuous query service" log_id=06yYTVo0000 service=continuous_querier
Mar 21 12:32:01 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:01.939116Z lvl=info msg="Starting HTTP service" log_id=06yYTVo0000 service=httpd authentication=false
Mar 21 12:32:01 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:01.942417Z lvl=info msg="Storing statistics" log_id=06yYTVo0000 service=monitor db_instance=_internal db_rp=monitor interval=10s
Mar 21 12:32:01 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:01.942932Z lvl=info msg="opened HTTP access log" log_id=06yYTVo0000 service=httpd path=stderr
Mar 21 12:32:01 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:01.946418Z lvl=info msg="Listening on HTTP" log_id=06yYTVo0000 service=httpd addr=[::]:8086 https=false
Mar 21 12:32:01 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:01.946447Z lvl=info msg="Starting retention policy enforcement service" log_id=06yYTVo0000 service=retention check_interval=30m
Mar 21 12:32:01 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:01.947004Z lvl=info msg="Listening for signals" log_id=06yYTVo0000
Mar 21 12:32:01 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:01.964740Z lvl=info msg="Sending usage statistics to usage.influxdata.com" log_id=06yYTVo0000
Mar 21 12:32:02 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:02.888415Z lvl=info msg="Cache snapshot (start)" log_id=06yYTVo0000 engine=tsm1 trace_id=06yYnTn0000 op_name=tsm1_cache_snapshot op_event=start
Mar 21 12:32:02 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:02.897199Z lvl=info msg="Cache snapshot (start)" log_id=06yYTVo0000 engine=tsm1 trace_id=06yYnTpG000 op_name=tsm1_cache_snapshot op_event=start
Mar 21 12:32:02 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:02.904226Z lvl=info msg="Snapshot for path written" log_id=06yYTVo0000 engine=tsm1 trace_id=06yYnTpG000 op_name=tsm1_cache_snapshot path=/home/influxdb/data/solar_cleaning_comparison/autogen/1439 duration=7.038ms
Mar 21 12:32:02 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:02.904245Z lvl=info msg="Cache snapshot (end)" log_id=06yYTVo0000 engine=tsm1 trace_id=06yYnTpG000 op_name=tsm1_cache_snapshot op_event=end op_elapsed=7.055ms
Mar 21 12:32:02 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:02.931181Z lvl=info msg="Cache snapshot (start)" log_id=06yYTVo0000 engine=tsm1 trace_id=06yYnTxl000 op_name=tsm1_cache_snapshot op_event=start
Mar 21 12:32:02 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:02.960249Z lvl=info msg="Snapshot for path written" log_id=06yYTVo0000 engine=tsm1 trace_id=06yYnTxl000 op_name=tsm1_cache_snapshot path=/home/influxdb/data/solar_network/autogen/1438 duration=29.075ms
Mar 21 12:32:02 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:02.960269Z lvl=info msg="Cache snapshot (end)" log_id=06yYTVo0000 engine=tsm1 trace_id=06yYnTxl000 op_name=tsm1_cache_snapshot op_event=end op_elapsed=29.093ms
Mar 21 12:32:03 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:03.063792Z lvl=info msg="Snapshot for path written" log_id=06yYTVo0000 engine=tsm1 trace_id=06yYnTn0000 op_name=tsm1_cache_snapshot path=/home/influxdb/data/_internal/monitor/1441 duration=175.390ms
Mar 21 12:32:03 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:03.063814Z lvl=info msg="Cache snapshot (end)" log_id=06yYTVo0000 engine=tsm1 trace_id=06yYnTn0000 op_name=tsm1_cache_snapshot op_event=end op_elapsed=175.410ms
Mar 21 12:32:25 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:25.435303Z lvl=info msg="Executing query" log_id=06yYTVo0000 service=query query="SELECT count(voltage), count(voltage) / 36 AS percent FROM solar_network.autogen.raw WHERE (quantity = 'global') AND time >= now() - 1d GROUP BY time(1h), \"name\""
Mar 21 12:32:25 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:25.435475Z lvl=info msg="Executing query" log_id=06yYTVo0000 service=query query="SELECT count(degrees), count(degrees) / 0.600 AS percent FROM solar_network.autogen.raw WHERE (quantity = 'tracker' AND channel = 'azimuth' AND input = '1') AND time >= now() - 1d
Mar 21 12:32:25 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:25.435647Z lvl=info msg="Executing query" log_id=06yYTVo0000 service=query query="SELECT count(voltage) / 3600 FROM solar_network.autogen.raw WHERE (quantity = 'global') AND time >= now() - 1d GROUP BY time(1h), \"name\""
Mar 21 12:32:25 scarlet.bom.gov.au influxd[11713]: [httpd] 134.178.21.2, 134.178.21.2,134.178.21.99 - grafana [21/Mar/2018:12:32:25 +1100] "GET /query?db=solar_network&epoch=ms&q=SELECT+count%28%22degrees%22%29%2C+count%28%22degrees%22%29++%2F+.6+AS+%22percent%22+FROM+%22raw%22+WHERE+%28%22quantity%22+%3D+%27tracker%27+AND+%22chann
Mar 21 12:32:25 scarlet.bom.gov.au influxd[11713]: [httpd] 134.178.21.2, 134.178.21.2,134.178.21.99 - grafana [21/Mar/2018:12:32:25 +1100] "GET /query?db=solar_network&epoch=ms&q=SELECT+count%28%22voltage%22%29++%2F+3600+FROM+%22raw%22+WHERE+%28%22quantity%22+%3D+%27global%27%29+AND+time+%3E%3D+now%28%29+-+24h+GROUP+BY+time%281h%29
Mar 21 12:32:25 scarlet.bom.gov.au influxd[11713]: [httpd] 134.178.21.2, 134.178.21.2,134.178.21.99 - grafana [21/Mar/2018:12:32:25 +1100] "GET /query?db=solar_network&epoch=ms&q=SELECT+count%28%22voltage%22%29%2C+count%28%22voltage%22%29++%2F+36+AS+%22percent%22+FROM+%22raw%22+WHERE+%28%22quantity%22+%3D+%27global%27%29+AND+time+%
Mar 21 12:32:26 scarlet.bom.gov.au systemd[1]: Stopping InfluxDB is an open-source, distributed, time series database...
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:26.832983Z lvl=info msg="Signal received, initializing clean shutdown..." log_id=06yYTVo0000
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:26.833010Z lvl=info msg="Waiting for clean shutdown..." log_id=06yYTVo0000
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:26.833023Z lvl=info msg="Shutting down monitor service" log_id=06yYTVo0000 service=monitor
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:26.833051Z lvl=info msg="Terminating storage of statistics" log_id=06yYTVo0000 service=monitor
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:26.833062Z lvl=info msg="Terminating precreation service" log_id=06yYTVo0000 service=shard-precreation
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:26.833077Z lvl=info msg="Listener closed" log_id=06yYTVo0000 service=snapshot
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:26.833085Z lvl=info msg="Terminating continuous query service" log_id=06yYTVo0000 service=continuous_querier
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11713]: ts=2018-03-21T01:32:26.833093Z lvl=info msg="Closing retention policy enforcement service" log_id=06yYTVo0000 service=retention

influx 1.4.2
#####downgraded to 1.4.2 (authentication=false) works
Mar 21 12:32:26 scarlet.bom.gov.au systemd[1]: Started InfluxDB is an open-source, distributed, time series database.
Mar 21 12:32:26 scarlet.bom.gov.au systemd[1]: Starting InfluxDB is an open-source, distributed, time series database…
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11792]: 8888888 .d888 888 8888888b. 888888b.
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11792]: 888 d88P" 888 888 "Y88b 888 "88b
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11792]: 888 888 888 888 888 888 .88P
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11792]: 888 88888b. 888888 888 888 888 888 888 888 888 8888888K.
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11792]: 888 888 "88b 888 888 888 888 Y8bd8P’ 888 888 888 "Y88b
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11792]: 888 888 888 888 888 888 888 X88K 888 888 888 888
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11792]: 888 888 888 888 888 Y88b 888 .d8"“8b. 888 .d88P 888 d88P
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11792]: 8888888 888 888 888 888 “Y88888 888 888 8888888P” 8888888P”
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:26Z InfluxDB starting, version 1.4.2, branch 1.4, commit 6d2685d1738277a1c2672fc58df7994627769be6
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:26Z Go version go1.9.2, GOMAXPROCS set to 8
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:26Z Using configuration at: /etc/influxdb/influxdb.conf
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:26Z Using data dir: /home/influxdb/data service=store
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:26Z /home/influxdb/data/solar_cleaning_comparison/autogen/13/000000008-000000004.tsm (#0) opened in 2.960892ms engine=tsm1 service=filestore
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:26Z /home/influxdb/data/solar_cleaning_comparison/autogen/19/000000013-000000002.tsm (#0) opened in 5.156624ms engine=tsm1 service=filestore
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:26Z /home/influxdb/data/solar_cleaning_comparison/autogen/13 opened in 12.890694ms service=store
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:26Z /home/influxdb/data/_internal/_series/01 opened in 13.274389ms service=store
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:26Z /home/influxdb/data/_internal/_series/02 opened in 13.073074ms service=store
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:26Z /home/influxdb/data/solar_cleaning_comparison/_series/01 opened in 12.94348ms service=store
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:26Z /home/influxdb/data/_internal/_series/04 opened in 13.589261ms service=store
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:26Z /home/influxdb/data/_internal/_series/03 opened in 14.087111ms service=store
Mar 21 12:32:26 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:26Z /home/influxdb/data/solar_cleaning_comparison/_series/06 opened in 464.339Âµs service=store
Mar 21 12:32:27 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:26Z /home/influxdb/data/_internal/_series/05 opened in 14.284655ms service=store
Mar 21 12:32:27 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:26Z /home/influxdb/data/solar_cleaning_comparison/_series/07 opened in 454.849Âµs service=store
Mar 21 12:32:27 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:26Z /home/influxdb/data/solar_cleaning_comparison/_series/03 opened in 396.639Âµs service=store
Mar 21 12:32:27 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:26Z /home/influxdb/data/solar_cleaning_comparison/autogen/19 opened in 13.670479ms service=store
Mar 21 12:32:27 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:26Z /home/influxdb/data/solar_cleaning_comparison/_series/02 opened in 707.324Âµs service=store
Mar 21 12:32:27 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:27Z /home/influxdb/data/solar_cleaning_comparison/autogen/14/000000016-000000004.tsm (#0) opened in 5.508163ms engine=tsm1 service=filestore
Mar 21 12:32:27 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:27Z /home/influxdb/data/_internal/_series/00 opened in 6.253273ms service=store
Mar 21 12:32:27 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:27Z /home/influxdb/data/_internal/_series/06 opened in 636.352Âµs service=store

....

Mar 21 12:32:33 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:33Z /home/influxdb/data/solar_network/autogen/94 opened in 25.991588ms service=store
Mar 21 12:32:33 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:33Z opened service service=subscriber
Mar 21 12:32:33 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:33Z Starting monitor system service=monitor
Mar 21 12:32:33 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:33Z 'build' registered for diagnostics monitoring service=monitor
Mar 21 12:32:33 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:33Z 'runtime' registered for diagnostics monitoring service=monitor
Mar 21 12:32:33 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:33Z 'network' registered for diagnostics monitoring service=monitor
Mar 21 12:32:33 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:33Z 'system' registered for diagnostics monitoring service=monitor
Mar 21 12:32:33 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:33Z Starting precreation service with check interval of 10m0s, advance period of 30m0s service=shard-precreation
Mar 21 12:32:33 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:33Z Starting snapshot service service=snapshot
Mar 21 12:32:33 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:33Z Starting continuous query service service=continuous_querier
Mar 21 12:32:33 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:33Z Starting HTTP service service=httpd
Mar 21 12:32:33 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:33Z Authentication enabled:false service=httpd
Mar 21 12:32:33 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:33Z Storing statistics in database '_internal' retention policy 'monitor', at interval 10s service=monitor
Mar 21 12:32:33 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:33Z Listening on HTTP:[::]:8086 service=httpd
Mar 21 12:32:33 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:33Z Starting retention policy enforcement service with check interval of 30m0s service=retention
Mar 21 12:32:33 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:33Z Listening for signals
Mar 21 12:32:33 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:33Z Sending usage statistics to usage.influxdata.com
Mar 21 12:32:34 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:34Z beginning level 1 compaction, 2 TSM files engine=tsm1
Mar 21 12:32:34 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:34Z compacting level 1 /home/influxdb/data/_internal/monitor/1441/000000040-000000001.tsm (#0) engine=tsm1
Mar 21 12:32:34 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:34Z compacting level 1 /home/influxdb/data/_internal/monitor/1441/000000042-000000001.tsm (#1) engine=tsm1
Mar 21 12:32:34 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:34Z beginning level 1 compaction, 3 TSM files engine=tsm1
Mar 21 12:32:34 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:34Z compacting level 1 /home/influxdb/data/solar_network/autogen/1438/000000235-000000001.tsm (#0) engine=tsm1
Mar 21 12:32:34 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:34Z compacting level 1 /home/influxdb/data/solar_network/autogen/1438/000000237-000000001.tsm (#1) engine=tsm1
Mar 21 12:32:34 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:34Z compacting level 1 /home/influxdb/data/solar_network/autogen/1438/000000239-000000001.tsm (#2) engine=tsm1

...

Mar 21 12:32:35 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:35Z beginning level 2 compaction, 2 TSM files engine=tsm1
Mar 21 12:32:35 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:35Z compacting level 2 /home/influxdb/data/solar_network/autogen/1438/000000234-000000002.tsm (#0) engine=tsm1
Mar 21 12:32:35 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:35Z compacting level 2 /home/influxdb/data/solar_network/autogen/1438/000000239-000000002.tsm (#1) engine=tsm1
Mar 21 12:32:35 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:35Z beginning level 2 compaction, 2 TSM files engine=tsm1
Mar 21 12:32:35 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:35Z compacting level 2 /home/influxdb/data/solar_cleaning_comparison/autogen/1439/000000002-000000002.tsm (#0) engine=tsm1
Mar 21 12:32:35 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:35Z compacting level 2 /home/influxdb/data/solar_cleaning_comparison/autogen/1439/000000006-000000002.tsm (#1) engine=tsm1

...

Mar 21 12:32:36 scarlet.bom.gov.au influxd[11792]: [httpd] ::1 - influx_admin [21/Mar/2018:12:32:36 +1100] "GET /ping HTTP/1.1" 204 0 "-" "InfluxDBShell/1.4.2" bc658033-2ca7-11e8-8001-000000000000 67
Mar 21 12:32:36 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:36Z compacted level 2 into /home/influxdb/data/_internal/monitor/1441/000000042-000000003.tsm.tmp (#0) engine=tsm1
Mar 21 12:32:36 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:36Z compacted level 2 2 files into 1 files in 659.439576ms engine=tsm1
Mar 21 12:32:43 scarlet.bom.gov.au influxd[11792]: [httpd] 134.178.21.128 - solar_influx [21/Mar/2018:12:32:43 +1100] "POST /write?db=solar_cleaning_comparison HTTP/1.1" 204 0 "-" "python-requests/2.18.4" c0ad5fb0-2ca7-11e8-8002-000000000000 4375
Mar 21 12:32:43 scarlet.bom.gov.au influxd[11792]: [httpd] 134.178.21.128 - solar_influx [21/Mar/2018:12:32:43 +1100] "POST /write?db=solar_cleaning_comparison HTTP/1.1" 204 0 "-" "python-requests/2.18.4" c0af8522-2ca7-11e8-8003-000000000000 2348
Mar 21 12:32:44 scarlet.bom.gov.au influxd[11792]: [httpd] 134.178.21.128 - solar_influx [21/Mar/2018:12:32:44 +1100] "POST /write?db=solar_cleaning_comparison HTTP/1.1" 204 0 "-" "python-requests/2.18.4" c144dc04-2ca7-11e8-8004-000000000000 2307
Mar 21 12:32:44 scarlet.bom.gov.au influxd[11792]: [httpd] 134.178.21.128 - solar_influx [21/Mar/2018:12:32:44 +1100] "POST /write?db=solar_cleaning_comparison HTTP/1.1" 204 0 "-" "python-requests/2.18.4" c1482478-2ca7-11e8-8005-000000000000 2569
Mar 21 12:32:45 scarlet.bom.gov.au influxd[11792]: [httpd] 134.178.21.128 - solar_influx [21/Mar/2018:12:32:45 +1100] "POST /write?db=solar_cleaning_comparison HTTP/1.1" 204 0 "-" "python-requests/2.18.4" c1dd888a-2ca7-11e8-8006-000000000000 2146
Mar 21 12:32:45 scarlet.bom.gov.au influxd[11792]: [httpd] 134.178.21.128 - solar_influx [21/Mar/2018:12:32:45 +1100] "POST /write?db=solar_cleaning_comparison HTTP/1.1" 204 0 "-" "python-requests/2.18.4" c1e0b64d-2ca7-11e8-8007-000000000000 2428

...

Mar 21 12:32:54 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:54Z SHOW TAG VALUES ON solar_network WITH KEY = rad_number WHERE (_name = 'raw') AND (("name" =~ /Cairns/) AND (_tagKey = 'rad_number')) service=query
Mar 21 12:32:54 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:54Z SELECT mean(voltage) AS voltage, mean(resistance) AS resistance FROM solar_network.autogen.raw WHERE (quantity = 'global' AND rad_number =~ /^402$/) AND time >= 201613h GROUP BY time(1w) service=query
Mar 21 12:32:54 scarlet.bom.gov.au influxd[11792]: [httpd] 134.178.22.144, 134.178.22.144,134.178.21.99 - grafana [21/Mar/2018:12:32:54 +1100] "GET /query?db=solar_network&epoch=ms&q=show+tag+values+from+%22raw%22+with+key%3D%22rad_number%22+where+%22name%22+%3D~+%2FCairns%2F HTTP/1.1" 200 118 "http://scarlet:3000/d/000000002/stati
Mar 21 12:32:54 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:54Z SELECT mean(voltage) AS voltage, mean(resistance) AS resistance FROM solar_network.autogen.raw WHERE (quantity = 'diffuse' AND rad_number =~ /^402$/) AND time >= 201613h GROUP BY time(1w) service=query
Mar 21 12:32:54 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:54Z SELECT mean(voltage) AS voltage, mean(resistance) AS resistance FROM solar_network.autogen.raw WHERE (quantity = 'direct' AND rad_number =~ /^402$/) AND time >= 201613h GROUP BY time(1w) service=query
Mar 21 12:32:54 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:54Z SELECT mean(voltage) FROM solar_network.autogen.raw WHERE (quantity = 'spo2' AND rad_number =~ /^402$/ AND input = '1') AND time >= 201613h GROUP BY time(1w), channel service=query
Mar 21 12:32:54 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:54Z SELECT mean(voltage) AS voltage, mean(resistance) AS resistance FROM solar_network.autogen.raw WHERE (quantity = 'longwave' AND rad_number =~ /^402$/) AND time >= 201613h GROUP BY time(1w), channel service=query
Mar 21 12:32:54 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:54Z SHOW TAG VALUES ON solar_network WITH KEY = "name" WHERE _tagKey = 'name' service=query
Mar 21 12:32:54 scarlet.bom.gov.au influxd[11792]: [httpd] 134.178.22.144, 134.178.22.144,134.178.21.99 - grafana [21/Mar/2018:12:32:54 +1100] "GET /query?db=solar_network&epoch=ms&q=show+tag+values+with+key+%3D+%22name%22 HTTP/1.1" 200 403 "http://scarlet:3000/d/000000002/station-display?orgId=1" "Mozilla/5.0 (Windows NT 6.1; Win6
Mar 21 12:32:54 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:54Z SELECT mean(voltage) FROM solar_network.autogen.raw WHERE (quantity = 'spo2' AND rad_number =~ /^402$/ AND input = '2') AND time >= 201613h GROUP BY time(1w), channel service=query
Mar 21 12:32:54 scarlet.bom.gov.au influxd[11792]: [httpd] 134.178.22.144, 134.178.22.144,134.178.21.99 - grafana [21/Mar/2018:12:32:54 +1100] "GET /query?db=solar_network&epoch=ms&q=SELECT+mean%28%22voltage%22%29+FROM+%22raw%22+WHERE+%28%22quantity%22+%3D+%27spo2%27+AND+%22rad_number%22+%3D~+%2F%5E402%24%2F+AND+%22input%22+%3D+%27
Mar 21 12:32:54 scarlet.bom.gov.au influxd[11792]: [I] 2018-03-21T01:32:54Z SELECT mean(temperature) FROM solar_network.autogen.raw WHERE (quantity = 'temperature' AND rad_number =~ /^402$/) AND time >= 201613h GROUP BY time(1w), quantity fill(none) service=query

mark · March 22, 2018, 3:25pm

msg="Executing query" log_id=06yYTVo0000 service=query query="SELECT count(voltage), count(voltage) / 36 AS percent FROM solar_network.autogen.raw WHERE (quantity = 'global') AND time >= now() - 1d GROUP BY time(1h), \"name\""

You have some queries from Grafana being handled in the 1.5 logs, so the server seems to be starting correctly.

Since you’re on CentOS, I wonder if you’re just seeing long startup times as described in [inmem] Startup in 1.5.0 is much slower than in 1.3.5 and 1.4.2 · Issue #9534 · influxdata/influxdb · GitHub (fix in Revert "Use MADV_WILLNEED when loading TSM files" by benbjohnson · Pull Request #9612 · influxdata/influxdb · GitHub).

nextrama · March 22, 2018, 9:49pm

Hmmm it could be slow start up times as I never let the service run for more than 5 minutes at time and given that the production servers database is 142GB compared to 6GB on the dev box.

I will add more data to the dev box and see what i see.

Topic		Replies	Views
Influxdb: Getting connection refused after installing SSL influxdb	6	6718	June 22, 2020
Failed to connect to http://localhost:8086: Get http://localhost:8086/ping: dial tcp [::1]:8086: connect: connection refused	3	8533	October 5, 2020
After upgrading to 1.5 and migrating the index to tsi1 influx won't start completely influxdb	3	930	March 18, 2018
Unable to connect to influxdb influxdb	0	1623	July 26, 2017
Influxdb service Down	4	1332	May 8, 2019

Upgrade to 1.5 fails with authentication enabled

Related Topics