I upgraded influx, and no matter how I try to write data I get timeouts. Both CLI and Python
Version: InfluxDB 2.0.8 (git: e91d41810f) build_date: 2021-08-13T18:22:30Z
I completely cleared my installation, removed all files under ~/.influxdbv2, recreated buckets, rebooted etc, ran influxd with --http-write-timeout 0
Here is a simple example – loads a few hundred lines of a file then quits
(base) [laplace(fcoetzee):/data01/projects/TMP] $ influx write -o witblits -b kibot -f influx_load.txt
Error: Failed to write data: unexpected error writing points to database: timeout.
See ‘influx write -h’ for help
(base) [laplace(fcoetzee):/data01/projects/TMP] $ wc influx_load.txt
2465000 7395000 329590623 influx_load.txt
(base) [laplace(fcoetzee):/data01/projects/TMP] $ head influx_load.txt
kibot_eod_by_sym,sym=AC__2010F close=2.13,date_gmt=20080114i,high=2.13,low=2.13,oi=0i,open=2.13,volume=0i 1200367800000000000
kibot_eod_by_sym,sym=AC__2010F close=2.1,date_gmt=20080115i,high=2.1,low=2.1,oi=0i,open=2.1,volume=0i 1200454200000000000
kibot_eod_by_sym,sym=AC__2010F close=2.06,date_gmt=20080116i,high=2.06,low=2.06,oi=0i,open=2.06,volume=0i 1200540600000000000
kibot_eod_by_sym,sym=AC__2010F close=2.07,date_gmt=20080117i,high=2.07,low=2.07,oi=0i,open=2.07,volume=0i 1200627000000000000
kibot_eod_by_sym,sym=AC__2010F close=2.08,date_gmt=20080118i,high=2.08,low=2.08,oi=0i,open=2.08,volume=0i 1200713400000000000
kibot_eod_by_sym,sym=AC__2010F close=2.03,date_gmt=20080122i,high=2.03,low=2.03,oi=0i,open=2.03,volume=0i 1201059000000000000
kibot_eod_by_sym,sym=AC__2010F close=2.02,date_gmt=20080123i,high=2.02,low=2.02,oi=0i,open=2.02,volume=0i 1201145400000000000
kibot_eod_by_sym,sym=AC__2010F close=2.02,date_gmt=20080124i,high=2.02,low=2.02,oi=0i,open=2.02,volume=0i 1201231800000000000
kibot_eod_by_sym,sym=AC__2010F close=2.02,date_gmt=20080125i,high=2.02,low=2.02,oi=0i,open=2.02,volume=0i 1201318200000000000
kibot_eod_by_sym,sym=AC__2010F close=2.03,date_gmt=20080128i,high=2.03,low=2.03,oi=0i,open=2.03,volume=0i 1201577400000000000
One thing – even if trying to load just a few hundred lines a ton of reindexing takes place, lot of disk IO
ts=2021-10-08T10:40:03.745363Z lvl=info msg=“index opened with 8 partitions” log_id=0X3sekrG000 service=storage-engine index=tsi
ts=2021-10-08T10:40:03.745398Z lvl=info msg=“index opened with 8 partitions” log_id=0X3sekrG000 service=storage-engine index=tsi
ts=2021-10-08T10:40:03.745438Z lvl=info msg=“Reading file” log_id=0X3sekrG000 service=storage-engine engine=tsm1 service=cacheloader path=/root/.influxdbv2/engine/wal/7109037767e8fb1b/autogen/668/_00001.wal size=296
ts=2021-10-08T10:40:03.745458Z lvl=info msg=“index opened with 8 partitions” log_id=0X3sekrG000 service=storage-engine index=tsi
ts=2021-10-08T10:40:03.745535Z lvl=info msg=“Opened shard” log_id=0X3sekrG000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/root/.influxdbv2/engine/data/7109037767e8fb1b/autogen/222 duration=9.825ms
ts=2021-10-08T10:40:03.745739Z lvl=info msg=“Reading file” log_id=0X3sekrG000 service=storage-engine engine=tsm1 service=cacheloader path=/root/.influxdbv2/engine/wal/7109037767e8fb1b/autogen/442/_00001.wal size=1127
ts=2021-10-08T10:40:03.745883Z lvl=info msg=“Opened shard” log_id=0X3sekrG000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/root/.influxdbv2/engine/data/7109037767e8fb1b/autogen/441 duration=14.045ms
ts=2021-10-08T10:40:03.746002Z lvl=info msg=“Reading file” log_id=0X3sekrG000 service=storage-engine engine=tsm1 service=cacheloader path=/root/.influxdbv2/engine/wal/7109037767e8fb1b/autogen/663/_00001.wal size=292
ts=2021-10-08T10:40:03.746147Z lvl=info msg=“index opened with 8 partitions” log_id=0X3sekrG000 service=storage-engine index=tsi
ts=2021-10-08T10:40:03.746629Z lvl=info msg=“Opened shard” log_id=0X3sekrG000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/root/.influxdbv2/engine/data/7109037767e8fb1b/autogen/651 duration=10.616ms
ts=2021-10-08T10:40:03.746729Z lvl=info msg=“Reading file” log_id=0X3sekrG000 service=storage-engine engine=tsm1 service=cacheloader path=/root/.influxdbv2/engine/wal/7109037767e8fb1b/autogen/382/_00001.wal size=1175
ts=2021-10-08T10:40:03.746972Z lvl=info msg=“Opened shard” log_id=0X3sekrG000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/root/.influxdbv2/engine/data/7109037767e8fb1b/autogen/442 duration=14.700ms
ts=2021-10-08T10:40:03.747095Z lvl=info msg=“Reading file” log_id=0X3sekrG000 service=storage-engine engine=tsm1 service=cacheloader path=/root/.influxdbv2/engine/wal/7109037767e8fb1b/autogen/443/_00001.wal size=1175
ts=2021-10-08T10:40:03.747226Z lvl=info msg=“Reading file” log_id=0X3sekrG000 service=storage-engine engine=tsm1 service=cacheloader path=/root/.influxdbv2/engine/wal/7109037767e8fb1b/autogen/357/_00001.wal size=1355
ts=2021-10-08T10:40:03.747248Z lvl=info msg=“Reading file” log_id=0X3sekrG000 service=storage-engine engine=tsm1 service=cacheloader path=/root/.influxdbv2/engine/wal/7109037767e8fb1b/autogen/678/_00001.wal size=296
ts=2021-10-08T10:40:03.747395Z lvl=info msg=“Opened shard” log_id=0X3sekrG000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/root/.influxdbv2/engine/data/7109037767e8fb1b/autogen/678 duration=15.050ms
ts=2021-10-08T10:40:03.745891Z lvl=info msg=“Opened shard” log_id=0X3sekrG000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/root/.influxdbv2/engine/data/7109037767e8fb1b/autogen/596 duration=12.680ms
ts=2021-10-08T10:40:03.748882Z lvl=info msg=“Opened shard” log_id=0X3sekrG000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/root/.influxdbv2/engine/data/7109037767e8fb1b/autogen/263 duration=17.022ms
ts=2021-10-08T10:40:03.749288Z lvl=info msg=“Opened shard” log_id=0X3sekrG000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/root/.influxdbv2/engine/data/7109037767e8fb1b/autogen/663 duration=17.183ms
ts=2021-10-08T10:40:03.749374Z lvl=info msg=“index opened with 8 partitions” log_id=0X3sekrG000 service=storage-engine index=tsi
ts=2021-10-08T10:40:03.749052Z lvl=info msg=“Opened shard” log_id=0X3sekrG000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/root/.influxdbv2/engine/data/7109037767e8fb1b/autogen/357 duration=12.327ms
ts=2021-10-08T10:40:03.749288Z lvl=info msg=“Opened shard” log_id=0X3sekrG000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/root/.influxdbv2/engine/data/7109037767e8fb1b/autogen/668 duration=13.420ms
ts=2021-10-08T10:40:03.750264Z lvl=info msg=“Opened shard” log_id=0X3sekrG000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/root/.influxdbv2/engine/data/7109037767e8fb1b/autogen/443 duration=13.908ms
ts=2021-10-08T10:40:03.750518Z lvl=info msg=“Opened shard” log_id=0X3sekrG000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/root/.influxdbv2/engine/data/7109037767e8fb1b/autogen/382 duration=18.688ms
ts=2021-10-08T10:40:03.750486Z lvl=info msg=“Reading file” log_id=0X3sekrG000 service=storage-engine engine=tsm1 service=cacheloader path=/root/.influxdbv2/engine/wal/7109037767e8fb1b/autogen/66/_00001.wal size=2344
ts=2021-10-08T10:40:03.752722Z lvl=info msg=“index opened with 8 partitions” log_id=0X3sekrG000 service=storage-engine index=tsi
ts=2021-10-08T10:40:03.752711Z lvl=info msg=“Opened shard” log_id=0X3sekrG000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/root/.influxdbv2/engine/data/7109037767e8fb1b/autogen/66 duration=28.367ms
ts=2021-10-08T10:40:03.753637Z lvl=info msg=“Reading file” log_id=0X3sekrG000 service=storage-engine engine=tsm1 service=cacheloader path=/root/.influxdbv2/engine/wal/7109037767e8fb1b/autogen/642/_00001.wal size=290
ts=2021-10-08T10:40:03.753958Z lvl=info msg=“Opened shard” log_id=0X3sekrG000 service=storage-engine service=store op_name=tsdb_open index_version=tsi1 path=/root/.influxdbv2/engine/data/7109037767e8fb1b/autogen/642 duration=16.428ms