hi, i’m trying to batch insert some 20 million point into a series. i’m running the official influxdb docker container. little bit after i start, docker image quits. how can i tell what is going wrong? thanks.
@aozoren Are you mounting a host volume for the data? How are running docker? Can you post the logs from the influxdb container?
i’m not mounting a host volume for data. i didn’t know i had to and i don’t know how but i’ll look into it. i’m running docker using kitematic on a mac with 16 ram and pci ssds. logs are as follows:
[cut]
8888888 .d888 888 8888888b. 888888b.
888 d88P" 888 888 "Y88b 888 "88b
888 888 888 888 888 888 .88P
888 88888b. 888888 888 888 888 888 888 888 888 8888888K.
888 888 "88b 888 888 888 888 Y8bd8P’ 888 888 888 “Y88b
888 888 888 888 888 888 888 X88K 888 888 888 888
888 888 888 888 888 Y88b 888 .d8"“8b. 888 .d88P 888 d88P
8888888 888 888 888 888 “Y88888 888 888 8888888P” 8888888P”
[I] 2017-04-24T20:14:11Z InfluxDB starting, version 1.2.2, branch master, commit 1bcf3ae74c6b9c4897dab68d513d056277eb24f7
[I] 2017-04-24T20:14:11Z Go version go1.7.4, GOMAXPROCS set to 4
[I] 2017-04-24T20:14:11Z Using configuration at: /etc/influxdb/influxdb.conf
[I] 2017-04-24T20:14:12Z Using data dir: /var/lib/influxdb/data service=store
[I] 2017-04-24T20:14:12Z /var/lib/influxdb/data/_internal/monitor/3/000000001-000000001.tsm (#0) opened in 2.740193ms engine=tsm1 service=filestore
[I] 2017-04-24T20:14:12Z reading file /var/lib/influxdb/wal/_internal/monitor/3/_00002.wal, size 63322 engine=tsm1 service=cacheloader
[I] 2017-04-24T20:14:12Z /var/lib/influxdb/data/_internal/monitor/1/000000001-000000001.tsm (#0) opened in 2.925369ms engine=tsm1 service=filestore
[I] 2017-04-24T20:14:12Z reading file /var/lib/influxdb/wal/_internal/monitor/1/_00005.wal, size 0 engine=tsm1 service=cacheloader
[I] 2017-04-24T20:14:12Z /var/lib/influxdb/data/_internal/monitor/1 database index loaded in 5.398485ms service=shard
[I] 2017-04-24T20:14:12Z /var/lib/influxdb/data/_internal/monitor/1 opened in 15.549435ms service=store
[I] 2017-04-24T20:14:12Z reading file /var/lib/influxdb/wal/_internal/monitor/3/_00003.wal, size 0 engine=tsm1 service=cacheloader
[I] 2017-04-24T20:14:12Z /var/lib/influxdb/data/_internal/monitor/3 database index loaded in 6.667754ms service=shard
[I] 2017-04-24T20:14:12Z /var/lib/influxdb/data/_internal/monitor/3 opened in 33.147098ms service=store
[I] 2017-04-24T20:14:12Z /var/lib/influxdb/data/db1/autogen/2/000000027-000000002.tsm (#0) opened in 30.713635ms engine=tsm1 service=filestore
[I] 2017-04-24T20:14:12Z /var/lib/influxdb/data/db1/autogen/2/000000028-000000001.tsm (#1) opened in 33.656983ms engine=tsm1 service=filestore
[I] 2017-04-24T20:14:12Z reading file /var/lib/influxdb/wal/db1/autogen/2/_00040.wal, size 0 engine=tsm1 service=cacheloader
[I] 2017-04-24T20:14:12Z /var/lib/influxdb/data/db1/autogen/2 database index loaded in 93.004562ms service=shard
[I] 2017-04-24T20:14:12Z /var/lib/influxdb/data/db1/autogen/2 opened in 131.062235ms service=store
[I] 2017-04-24T20:14:12Z opened service service=subscriber
[I] 2017-04-24T20:14:12Z Starting monitor system service=monitor
[I] 2017-04-24T20:14:12Z ‘build’ registered for diagnostics monitoring service=monitor
[I] 2017-04-24T20:14:12Z ‘runtime’ registered for diagnostics monitoring service=monitor
[I] 2017-04-24T20:14:12Z ‘network’ registered for diagnostics monitoring service=monitor
[I] 2017-04-24T20:14:12Z ‘system’ registered for diagnostics monitoring service=monitor
[I] 2017-04-24T20:14:12Z Starting precreation service with check interval of 10m0s, advance period of 30m0s service=shard-precreation
[I] 2017-04-24T20:14:12Z Starting snapshot service service=snapshot
[I] 2017-04-24T20:14:12Z Starting continuous query service service=continuous_querier
[I] 2017-04-24T20:14:12Z Starting HTTP service service=httpd
[I] 2017-04-24T20:14:12Z Authentication enabled:false service=httpd
[I] 2017-04-24T20:14:12Z Listening on HTTP:[::]:8086 service=httpd
[I] 2017-04-24T20:14:12Z Starting retention policy enforcement service with check interval of 30m0s service=retention
[I] 2017-04-24T20:14:12Z Listening for signals
[I] 2017-04-24T20:14:12Z Sending usage statistics to usage.influxdata.com
[I] 2017-04-24T20:14:12Z Storing statistics in database ‘_internal’ retention policy ‘monitor’, at interval 10s service=monitor
[httpd] ::1 - - [24/Apr/2017:20:14:22 +0000] “GET /ping HTTP/1.1” 204 0 “-” “InfluxDBShell/1.2.2” 9af7e0c1-292a-11e7-8001-000000000000 391
[I] 2017-04-24T20:14:26Z DROP SERIES FROM tick service=query
[httpd] ::1 - - [24/Apr/2017:20:14:26 +0000] “POST /query?chunked=true&db=&epoch=ns&q=drop+series+from+tick HTTP/1.1” 200 98 “-” “InfluxDBShell/1.2.2” 9db400ba-292a-11e7-8002-000000000000 7509
[I] 2017-04-24T20:14:29Z SHOW DATABASES service=query
[httpd] ::1 - - [24/Apr/2017:20:14:29 +0000] “POST /query?db=&epoch=ns&q=SHOW+DATABASES HTTP/1.1” 200 121 “-” “InfluxDBShell/1.2.2” 9f61b067-292a-11e7-8003-000000000000 1031
[I] 2017-04-24T20:14:31Z DROP SERIES FROM tick service=query
[httpd] ::1 - - [24/Apr/2017:20:14:31 +0000] “POST /query?chunked=true&db=db1&epoch=ns&q=drop+series+from+tick HTTP/1.1” 200 67 “-” “InfluxDBShell/1.2.2” a0374cb8-292a-11e7-8004-000000000000 454451
[httpd] 172.17.0.1 - - [24/Apr/2017:20:21:18 +0000] “GET /ping HTTP/1.1” 204 0 “-” “okhttp/3.5.0” 92e75135-292b-11e7-8005-000000000000 48
[I] 2017-04-24T20:21:18Z CREATE DATABASE db1 service=query
[httpd] 172.17.0.1 - root [24/Apr/2017:20:21:18 +0000] “POST /query?p=%5BREDACTED%5D&q=CREATE+DATABASE+%22db1%22&u=root HTTP/1.1” 200 62 “-” “okhttp/3.5.0” 92eac431-292b-11e7-8006-000000000000 842
[httpd] 172.17.0.1 - root [24/Apr/2017:20:21:40 +0000] “POST /write?consistency=one&db=db1&p=%5BREDACTED%5D&precision=n&rp=autogen&u=root HTTP/1.1” 204 0 “-” “okhttp/3.5.0” a0217955-292b-11e7-8007-000000000000 65893
[httpd] 172.17.0.1 - root [24/Apr/2017:20:21:40 +0000] “POST /write?consistency=one&db=db1&p=%5BREDACTED%5D&precision=n&rp=autogen&u=root HTTP/1.1” 204 0 “-” “okhttp/3.5.0” a04cce9f-292b-11e7-8008-000000000000 243906
[httpd] 172.17.0.1 - root [24/Apr/2017:20:21:41 +0000] “POST /write?consistency=one&db=db1&p=%5BREDACTED%5D&precision=n&rp=autogen&u=root HTTP/1.1” 204 0 “-” “okhttp/3.5.0” a0c7c736-292b-11e7-8009-000000000000 777962
[httpd] 172.17.0.1 - root [24/Apr/2017:20:21:43 +0000] “POST /write?consistency=one&db=db1&p=%5BREDACTED%5D&precision=n&rp=autogen&u=root HTTP/1.1” 204 0 “-” “okhttp/3.5.0” a1b22ff9-292b-11e7-800a-000000000000 1716126
[I] 2017-04-24T20:21:45Z Snapshot for path /var/lib/influxdb/data/db1/autogen/2 written in 455.279418ms engine=tsm1
[I] 2017-04-24T20:21:46Z beginning level 1 compaction of group 0, 2 TSM files engine=tsm1
[I] 2017-04-24T20:21:46Z compacting level 1 group (0) /var/lib/influxdb/data/db1/autogen/2/000000028-000000001.tsm (#0) engine=tsm1
[I] 2017-04-24T20:21:46Z compacting level 1 group (0) /var/lib/influxdb/data/db1/autogen/2/000000030-000000001.tsm (#1) engine=tsm1
[I] 2017-04-24T20:21:46Z beginning level 2 compaction of group 0, 1 TSM files engine=tsm1
[I] 2017-04-24T20:21:46Z compacting level 2 group (0) /var/lib/influxdb/data/db1/autogen/2/000000027-000000002.tsm (#0) engine=tsm1
[I] 2017-04-24T20:21:46Z compacted level 2 1 files into 0 files in 192.846067ms engine=tsm1
[I] 2017-04-24T20:21:47Z compacted level 1 group (0) into /var/lib/influxdb/data/db1/autogen/2/000000030-000000002.tsm.tmp (#0) engine=tsm1
[I] 2017-04-24T20:21:47Z compacted level 1 2 files into 1 files in 695.884524ms engine=tsm1
[httpd] 172.17.0.1 - root [24/Apr/2017:20:21:47 +0000] “POST /write?consistency=one&db=db1&p=%5BREDACTED%5D&precision=n&rp=autogen&u=root HTTP/1.1” 204 0 “-” “okhttp/3.5.0” a42e4a30-292b-11e7-800b-000000000000 3894234
[I] 2017-04-24T20:21:51Z Snapshot for path /var/lib/influxdb/data/db1/autogen/2 written in 251.90676ms engine=tsm1
[httpd] 172.17.0.1 - root [24/Apr/2017:20:21:59 +0000] “POST /write?consistency=one&db=db1&p=%5BREDACTED%5D&precision=n&rp=autogen&u=root HTTP/1.1” 204 0 “-” “okhttp/3.5.0” ab6ebc33-292b-11e7-800c-000000000000 7309547
[I] 2017-04-24T20:22:07Z Snapshot for path /var/lib/influxdb/data/db1/autogen/2 written in 487.185797ms engine=tsm1
[I] 2017-04-24T20:22:07Z beginning level 1 compaction of group 0, 2 TSM files engine=tsm1
[I] 2017-04-24T20:22:07Z compacting level 1 group (0) /var/lib/influxdb/data/db1/autogen/2/000000031-000000001.tsm (#0) engine=tsm1
[I] 2017-04-24T20:22:07Z compacting level 1 group (0) /var/lib/influxdb/data/db1/autogen/2/000000032-000000001.tsm (#1) engine=tsm1
[I] 2017-04-24T20:22:10Z compacted level 1 group (0) into /var/lib/influxdb/data/db1/autogen/2/000000032-000000002.tsm.tmp (#0) engine=tsm1
[I] 2017-04-24T20:22:10Z compacted level 1 2 files into 1 files in 2.665120068s engine=tsm1
[I] 2017-04-24T20:22:10Z beginning level 2 compaction of group 0, 2 TSM files engine=tsm1
[I] 2017-04-24T20:22:10Z compacting level 2 group (0) /var/lib/influxdb/data/db1/autogen/2/000000030-000000002.tsm (#0) engine=tsm1
[I] 2017-04-24T20:22:10Z compacting level 2 group (0) /var/lib/influxdb/data/db1/autogen/2/000000032-000000002.tsm (#1) engine=tsm1
[I] 2017-04-24T20:22:12Z compacted level 2 group (0) into /var/lib/influxdb/data/db1/autogen/2/000000032-000000003.tsm.tmp (#0) engine=tsm1
[I] 2017-04-24T20:22:12Z compacted level 2 2 files into 1 files in 1.626620001s engine=tsm1
[httpd] 172.17.0.1 - root [24/Apr/2017:20:22:26 +0000] “POST /write?consistency=one&db=db1&p=%5BREDACTED%5D&precision=n&rp=autogen&u=root HTTP/1.1” 500 44 “-” “okhttp/3.5.0” bba04f72-292b-11e7-800d-000000000000 31238803
[I] 2017-04-24T20:23:07Z Snapshot for path /var/lib/influxdb/data/db1/autogen/2 written in 8.36384854s engine=tsm1
8888888 .d888 888 8888888b. 888888b.
888 d88P” 888 888 "Y88b 888 "88b
888 888 888 888 888 888 .88P
888 88888b. 888888 888 888 888 888 888 888 888 8888888K.
888 888 "88b 888 888 888 888 Y8bd8P’ 888 888 888 “Y88b
888 888 888 888 888 888 888 X88K 888 888 888 888
888 888 888 888 888 Y88b 888 .d8"“8b. 888 .d88P 888 d88P
8888888 888 888 888 888 “Y88888 888 888 8888888P” 8888888P”
[I] 2017-04-24T20:30:26Z InfluxDB starting, version 1.2.2, branch master, commit 1bcf3ae74c6b9c4897dab68d513d056277eb24f7
[I] 2017-04-24T20:30:26Z Go version go1.7.4, GOMAXPROCS set to 4
[I] 2017-04-24T20:30:26Z Using configuration at: /etc/influxdb/influxdb.conf
[I] 2017-04-24T20:30:26Z Using data dir: /var/lib/influxdb/data service=store
[I] 2017-04-24T20:30:26Z /var/lib/influxdb/data/_internal/monitor/3/000000001-000000001.tsm (#0) opened in 4.566786ms engine=tsm1 service=filestore
[I] 2017-04-24T20:30:26Z reading file /var/lib/influxdb/wal/_internal/monitor/3/_00002.wal, size 63322 engine=tsm1 service=cacheloader
[I] 2017-04-24T20:30:26Z /var/lib/influxdb/data/_internal/monitor/1/000000001-000000001.tsm (#0) opened in 2.916279ms engine=tsm1 service=filestore
[I] 2017-04-24T20:30:26Z reading file /var/lib/influxdb/wal/_internal/monitor/1/_00006.wal, size 0 engine=tsm1 service=cacheloader
[I] 2017-04-24T20:30:26Z reading file /var/lib/influxdb/wal/_internal/monitor/3/_00003.wal, size 229164 engine=tsm1 service=cacheloader
[I] 2017-04-24T20:30:26Z /var/lib/influxdb/data/_internal/monitor/1 database index loaded in 13.600179ms service=shard
[I] 2017-04-24T20:30:26Z /var/lib/influxdb/data/_internal/monitor/1 opened in 23.916124ms service=store
[I] 2017-04-24T20:30:26Z /var/lib/influxdb/data/db1/autogen/2/000000033-000000001.tsm (#1) opened in 33.763036ms engine=tsm1 service=filestore
[I] 2017-04-24T20:30:26Z /var/lib/influxdb/data/db1/autogen/2/000000032-000000003.tsm (#0) opened in 38.950573ms engine=tsm1 service=filestore
[I] 2017-04-24T20:30:26Z reading file /var/lib/influxdb/wal/db1/autogen/2/_00045.wal, size 0 engine=tsm1 service=cacheloader
[I] 2017-04-24T20:30:26Z reading file /var/lib/influxdb/wal/_internal/monitor/3/_00004.wal, size 0 engine=tsm1 service=cacheloader
[I] 2017-04-24T20:30:26Z /var/lib/influxdb/data/_internal/monitor/3 database index loaded in 708.644µs service=shard
[I] 2017-04-24T20:30:26Z /var/lib/influxdb/data/_internal/monitor/3 opened in 58.294218ms service=store
[I] 2017-04-24T20:30:26Z /var/lib/influxdb/data/db1/autogen/2 database index loaded in 114.521431ms service=shard
[I] 2017-04-24T20:30:26Z /var/lib/influxdb/data/db1/autogen/2 opened in 159.856194ms service=store
[I] 2017-04-24T20:30:26Z opened service service=subscriber
[I] 2017-04-24T20:30:26Z Starting monitor system service=monitor
[I] 2017-04-24T20:30:26Z ‘build’ registered for diagnostics monitoring service=monitor
[I] 2017-04-24T20:30:26Z ‘runtime’ registered for diagnostics monitoring service=monitor
[I] 2017-04-24T20:30:26Z ‘network’ registered for diagnostics monitoring service=monitor
[I] 2017-04-24T20:30:26Z ‘system’ registered for diagnostics monitoring service=monitor
[I] 2017-04-24T20:30:26Z Starting precreation service with check interval of 10m0s, advance period of 30m0s service=shard-precreation
[I] 2017-04-24T20:30:26Z Starting snapshot service service=snapshot
[I] 2017-04-24T20:30:26Z Starting continuous query service service=continuous_querier
[I] 2017-04-24T20:30:26Z Starting HTTP service service=httpd
[I] 2017-04-24T20:30:26Z Authentication enabled:false service=httpd
[I] 2017-04-24T20:30:26Z Listening on HTTP:[::]:8086 service=httpd
[I] 2017-04-24T20:30:26Z Starting retention policy enforcement service with check interval of 30m0s service=retention
[I] 2017-04-24T20:30:26Z Listening for signals
[I] 2017-04-24T20:30:26Z Sending usage statistics to usage.influxdata.com
[I] 2017-04-24T20:30:26Z Storing statistics in database ‘_internal’ retention policy ‘monitor’, at interval 10s service=monitor
[httpd] ::1 - - [24/Apr/2017:20:30:59 +0000] “GET /ping HTTP/1.1” 204 0 “-” “InfluxDBShell/1.2.2” ed186694-292c-11e7-8001-000000000000 380
[httpd] ::1 - - [24/Apr/2017:20:33:45 +0000] “GET /ping HTTP/1.1” 204 0 “-” “InfluxDBShell/1.2.2” 500f7425-292d-11e7-8002-000000000000 57
[I] 2017-04-24T20:33:47Z SHOW DATABASES service=query
[httpd] ::1 - - [24/Apr/2017:20:33:47 +0000] “POST /query?db=&epoch=ns&q=SHOW+DATABASES HTTP/1.1” 200 121 “-” “InfluxDBShell/1.2.2” 51958b7c-292d-11e7-8003-000000000000 6021
[I] 2017-04-24T20:33:50Z SELECT “key” FROM db1.autogen._series service=query
[httpd] ::1 - - [24/Apr/2017:20:33:50 +0000] “POST /query?chunked=true&db=db1&epoch=ns&q=show+series HTTP/1.1” 200 58013 “-” “InfluxDBShell/1.2.2” 535f4f11-292d-11e7-8004-000000000000 68889
[I] 2017-04-24T20:34:00Z DROP SERIES FROM tic service=query
[httpd] ::1 - - [24/Apr/2017:20:34:00 +0000] “POST /query?chunked=true&db=db1&epoch=ns&q=drop+series+from+tic HTTP/1.1” 200 67 “-” “InfluxDBShell/1.2.2” 595a0d82-292d-11e7-8005-000000000000 21928
[I] 2017-04-24T20:34:02Z DROP SERIES FROM tick service=query
[httpd] ::1 - - [24/Apr/2017:20:34:02 +0000] “POST /query?chunked=true&db=db1&epoch=ns&q=drop+series+from+tick HTTP/1.1” 200 67 “-” “InfluxDBShell/1.2.2” 5a92866c-292d-11e7-8006-000000000000 421186
[I] 2017-04-24T20:38:55Z Signal received, initializing clean shutdown…
[I] 2017-04-24T20:38:55Z Waiting for clean shutdown…
[I] 2017-04-24T20:38:55Z shutting down monitor system service=monitor
[I] 2017-04-24T20:38:55Z terminating storage of statistics service=monitor
[I] 2017-04-24T20:38:55Z Precreation service terminating service=shard-precreation
[I] 2017-04-24T20:38:55Z snapshot listener closed service=snapshot
[I] 2017-04-24T20:38:55Z continuous query service terminating service=continuous_querier
[I] 2017-04-24T20:38:55Z retention policy enforcement terminating service=retention
[I] 2017-04-24T20:38:55Z closed service service=subscriber
[I] 2017-04-24T20:38:55Z server shutdown completed
8888888 .d888 888 8888888b. 888888b.
888 d88P” 888 888 "Y88b 888 "88b
888 888 888 888 888 888 .88P
888 88888b. 888888 888 888 888 888 888 888 888 8888888K.
888 888 "88b 888 888 888 888 Y8bd8P’ 888 888 888 "Y88b
888 888 888 888 888 888 888 X88K 888 888 888 888
888 888 888 888 888 Y88b 888 .d8"“8b. 888 .d88P 888 d88P
8888888 888 888 888 888 “Y88888 888 888 8888888P” 8888888P”
[I] 2017-04-24T20:39:00Z InfluxDB starting, version 1.2.2, branch master, commit 1bcf3ae74c6b9c4897dab68d513d056277eb24f7
[I] 2017-04-24T20:39:00Z Go version go1.7.4, GOMAXPROCS set to 4
[I] 2017-04-24T20:39:00Z Using configuration at: /etc/influxdb/influxdb.conf
[I] 2017-04-24T20:39:00Z Using data dir: /var/lib/influxdb/data service=store
[I] 2017-04-24T20:39:00Z /var/lib/influxdb/data/_internal/monitor/3/000000001-000000001.tsm (#0) opened in 355.67µs engine=tsm1 service=filestore
[I] 2017-04-24T20:39:00Z /var/lib/influxdb/data/_internal/monitor/1/000000001-000000001.tsm (#0) opened in 402.114µs engine=tsm1 service=filestore
[I] 2017-04-24T20:39:00Z reading file /var/lib/influxdb/wal/_internal/monitor/3/_00002.wal, size 63322 engine=tsm1 service=cacheloader
[I] 2017-04-24T20:39:00Z reading file /var/lib/influxdb/wal/_internal/monitor/1/_00007.wal, size 0 engine=tsm1 service=cacheloader
[I] 2017-04-24T20:39:00Z /var/lib/influxdb/data/_internal/monitor/1 database index loaded in 1.345575ms service=shard
[I] 2017-04-24T20:39:00Z /var/lib/influxdb/data/_internal/monitor/1 opened in 3.631615ms service=store
[I] 2017-04-24T20:39:00Z reading file /var/lib/influxdb/wal/_internal/monitor/3/_00003.wal, size 229164 engine=tsm1 service=cacheloader
[I] 2017-04-24T20:39:00Z reading file /var/lib/influxdb/wal/_internal/monitor/3/_00004.wal, size 203189 engine=tsm1 service=cacheloader
[I] 2017-04-24T20:39:00Z reading file /var/lib/influxdb/wal/_internal/monitor/3/_00005.wal, size 0 engine=tsm1 service=cacheloader
[I] 2017-04-24T20:39:00Z /var/lib/influxdb/data/_internal/monitor/3 database index loaded in 1.244097ms service=shard
[I] 2017-04-24T20:39:00Z /var/lib/influxdb/data/_internal/monitor/3 opened in 64.028282ms service=store
[I] 2017-04-24T20:39:00Z /var/lib/influxdb/data/db1/autogen/2/000000032-000000003.tsm (#0) opened in 117.105589ms engine=tsm1 service=filestore
[I] 2017-04-24T20:39:00Z /var/lib/influxdb/data/db1/autogen/2/000000033-000000001.tsm (#1) opened in 118.805936ms engine=tsm1 service=filestore
[I] 2017-04-24T20:39:00Z reading file /var/lib/influxdb/wal/db1/autogen/2/_00046.wal, size 0 engine=tsm1 service=cacheloader
[I] 2017-04-24T20:39:00Z /var/lib/influxdb/data/db1/autogen/2 database index loaded in 22.373µs service=shard
[I] 2017-04-24T20:39:00Z /var/lib/influxdb/data/db1/autogen/2 opened in 120.000792ms service=store
[I] 2017-04-24T20:39:00Z opened service service=subscriber
[I] 2017-04-24T20:39:00Z Starting monitor system service=monitor
[I] 2017-04-24T20:39:00Z ‘build’ registered for diagnostics monitoring service=monitor
[I] 2017-04-24T20:39:00Z ‘runtime’ registered for diagnostics monitoring service=monitor
[I] 2017-04-24T20:39:00Z ‘network’ registered for diagnostics monitoring service=monitor
[I] 2017-04-24T20:39:00Z ‘system’ registered for diagnostics monitoring service=monitor
[I] 2017-04-24T20:39:00Z Starting precreation service with check interval of 10m0s, advance period of 30m0s service=shard-precreation
[I] 2017-04-24T20:39:00Z Starting snapshot service service=snapshot
[I] 2017-04-24T20:39:00Z Starting continuous query service service=continuous_querier
[I] 2017-04-24T20:39:00Z Starting HTTP service service=httpd
[I] 2017-04-24T20:39:00Z Authentication enabled:false service=httpd
[I] 2017-04-24T20:39:00Z Listening on HTTP:[::]:8086 service=httpd
[I] 2017-04-24T20:39:00Z Starting retention policy enforcement service with check interval of 30m0s service=retention
[I] 2017-04-24T20:39:00Z Storing statistics in database ‘_internal’ retention policy ‘monitor’, at interval 10s service=monitor
[I] 2017-04-24T20:39:00Z Sending usage statistics to usage.influxdata.com
[I] 2017-04-24T20:39:00Z Listening for signals
[I] 2017-04-24T20:39:01Z beginning level 3 compaction of group 0, 1 TSM files engine=tsm1
[I] 2017-04-24T20:39:01Z compacting level 3 group (0) /var/lib/influxdb/data/db1/autogen/2/000000032-000000003.tsm (#0) engine=tsm1
[I] 2017-04-24T20:39:01Z beginning level 1 compaction of group 0, 1 TSM files engine=tsm1
[I] 2017-04-24T20:39:01Z compacting level 1 group (0) /var/lib/influxdb/data/db1/autogen/2/000000033-000000001.tsm (#0) engine=tsm1
[I] 2017-04-24T20:39:01Z compacted level 1 1 files into 0 files in 170.077323ms engine=tsm1
[I] 2017-04-24T20:39:01Z compacted level 3 1 files into 0 files in 197.300849ms engine=tsm1
[httpd] ::1 - - [24/Apr/2017:20:39:27 +0000] “GET /ping HTTP/1.1” 204 0 “-” “InfluxDBShell/1.2.2” 1beea2d7-292e-11e7-8001-000000000000 106
[I] 2017-04-24T20:39:28Z SHOW DATABASES service=query
[httpd] ::1 - - [24/Apr/2017:20:39:28 +0000] “POST /query?db=&epoch=ns&q=SHOW+DATABASES HTTP/1.1” 200 121 “-” “InfluxDBShell/1.2.2” 1cc26f6c-292e-11e7-8002-000000000000 2202
[I] 2017-04-24T20:39:31Z SELECT “key” FROM db1.autogen._series service=query
[httpd] ::1 - - [24/Apr/2017:20:39:31 +0000] “POST /query?chunked=true&db=db1&epoch=ns&q=show+series HTTP/1.1” 200 67 “-” “InfluxDBShell/1.2.2” 1e57f506-292e-11e7-8003-000000000000 1667
[httpd] 172.17.0.1 - - [24/Apr/2017:20:40:23 +0000] “GET /ping HTTP/1.1” 204 0 “-” “okhttp/3.5.0” 3dba61d1-292e-11e7-8004-000000000000 103
[I] 2017-04-24T20:40:23Z CREATE DATABASE db1 service=query
[httpd] 172.17.0.1 - root [24/Apr/2017:20:40:23 +0000] “POST /query?p=%5BREDACTED%5D&q=CREATE+DATABASE+%22db1%22&u=root HTTP/1.1” 200 62 “-” “okhttp/3.5.0” 3dbdd825-292e-11e7-8005-000000000000 792
[httpd] 172.17.0.1 - root [24/Apr/2017:20:40:44 +0000] “POST /write?consistency=one&db=db1&p=%5BREDACTED%5D&precision=n&rp=autogen&u=root HTTP/1.1” 204 0 “-” “okhttp/3.5.0” 4a31467f-292e-11e7-8006-000000000000 56969
[httpd] 172.17.0.1 - root [24/Apr/2017:20:40:45 +0000] “POST /write?consistency=one&db=db1&p=%5BREDACTED%5D&precision=n&rp=autogen&u=root HTTP/1.1” 204 0 “-” “okhttp/3.5.0” 4a565964-292e-11e7-8007-000000000000 236014
[httpd] 172.17.0.1 - root [24/Apr/2017:20:40:45 +0000] “POST /write?consistency=one&db=db1&p=%5BREDACTED%5D&precision=n&rp=autogen&u=root HTTP/1.1” 204 0 “-” “okhttp/3.5.0” 4ab807e5-292e-11e7-8008-000000000000 858524
[httpd] 172.17.0.1 - root [24/Apr/2017:20:40:48 +0000] “POST /write?consistency=one&db=db1&p=%5BREDACTED%5D&precision=n&rp=autogen&u=root HTTP/1.1” 204 0 “-” “okhttp/3.5.0” 4c196b6e-292e-11e7-8009-000000000000 1410656
[I] 2017-04-24T20:40:49Z Snapshot for path /var/lib/influxdb/data/db1/autogen/2 written in 247.047672ms engine=tsm1
[httpd] 172.17.0.1 - root [24/Apr/2017:20:40:52 +0000] “POST /write?consistency=one&db=db1&p=%5BREDACTED%5D&precision=n&rp=autogen&u=root HTTP/1.1” 204 0 “-” “okhttp/3.5.0” 4ecacb14-292e-11e7-800a-000000000000 3909371
[I] 2017-04-24T20:40:57Z Snapshot for path /var/lib/influxdb/data/db1/autogen/2 written in 357.352571ms engine=tsm1
[I] 2017-04-24T20:40:57Z beginning level 1 compaction of group 0, 2 TSM files engine=tsm1
[I] 2017-04-24T20:40:57Z compacting level 1 group (0) /var/lib/influxdb/data/db1/autogen/2/000000035-000000001.tsm (#0) engine=tsm1
[I] 2017-04-24T20:40:57Z compacting level 1 group (0) /var/lib/influxdb/data/db1/autogen/2/000000036-000000001.tsm (#1) engine=tsm1
[I] 2017-04-24T20:40:58Z compacted level 1 group (0) into /var/lib/influxdb/data/db1/autogen/2/000000036-000000002.tsm.tmp (#0) engine=tsm1
[I] 2017-04-24T20:40:58Z compacted level 1 2 files into 1 files in 1.245060897s engine=tsm1
[httpd] 172.17.0.1 - root [24/Apr/2017:20:41:06 +0000] “POST /write?consistency=one&db=db1&p=%5BREDACTED%5D&precision=n&rp=autogen&u=root HTTP/1.1” 204 0 “-” “okhttp/3.5.0” 5735a5d6-292e-11e7-800b-000000000000 8592836
[I] 2017-04-24T20:41:16Z Snapshot for path /var/lib/influxdb/data/db1/autogen/2 written in 976.981523ms engine=tsm1
[httpd] 172.17.0.1 - root [24/Apr/2017:20:41:46 +0000] “POST /write?consistency=one&db=db1&p=%5BREDACTED%5D&precision=n&rp=autogen&u=root HTTP/1.1” 500 44 “-” “okhttp/3.5.0” 6ed9177a-292e-11e7-800c-000000000000 19789318
I mapped a local folder as suggested but that didn’t stop container from crashing. I can see the data, meta, wal folders being used on local drive. I’m using the java api to write to db.
just one, “tick”. type and symbol fields are searchable. raw field is mostly < 255 chars but occasionally up to 4000 chars. this is the feed i get from a stock exchange.
Point p = Point.measurement( "tick" )
.time( time.getTime(), TimeUnit.MILLISECONDS )
.addField( "raw", value )
.addField( "multiplier", multiplier )
.tag( "type", type )
.tag( "symbol", symbol )
.build();sample points
1491894720000000000 1 060O_XU030E0617C112.000ÿ4ÿ5.8ÿ30ÿ3ÿ16ÿ8ÿ6ÿ8ÿ39ÿ89600ÿ22ÿ5.8ÿ97ÿ5.02ÿ46ÿ66.0ÿ101ÿ0.0ÿ112ÿ0.0ÿ38ÿ10:12:01ÿ37ÿ11/04/17ÿ O_XU030E0617C112.000 060
1491894720000000000 1 060O_XU030E0617P110.000ÿ4ÿ0.0ÿ30ÿ3ÿ22ÿ0.0ÿ17ÿ2.55ÿ19ÿ10ÿ97ÿ2.57ÿ46ÿ175.0ÿ101ÿ174.0ÿ112ÿ0.0ÿ38ÿ10:12:01ÿ37ÿ10/04/17ÿ O_XU030E0617P110.000 060
1491894720000000000 1 061UZD3PVÿ4ÿ0.0ÿ16ÿÿ6ÿ0ÿ39ÿ0ÿ17ÿ0.45ÿ18ÿ0.46ÿ22ÿ0.0ÿ30ÿ ÿ2ÿ0.0ÿ3ÿ0.0ÿ1ÿ0.0ÿ5ÿ0.53ÿ21ÿ0.0ÿ7ÿ0.53ÿ8ÿ0.53ÿ9ÿ0.53ÿ10ÿ0.53ÿ11ÿ0.53ÿ12ÿ0.53ÿ13ÿ0.0ÿ14ÿ0.0ÿ15ÿ0.0ÿ23ÿ0.53ÿ24ÿ0.53ÿ25ÿ0.53ÿ26ÿ0.0ÿ27ÿ0.0ÿ31ÿ0.53ÿ32ÿ0ÿ33ÿ0.0ÿ34ÿ0.0ÿ35ÿ0.0ÿ36ÿ0.0ÿ41ÿ0.0ÿ42ÿ0.0ÿ43ÿ ÿ44ÿ0.0ÿ45ÿ0.0ÿ46ÿ0.0ÿ55ÿ0.0ÿ56ÿ0.0ÿ57ÿ0ÿ58ÿ0ÿ59ÿ0.0ÿ60ÿ0.0ÿ61ÿ0.0ÿ64ÿ0.0ÿ65ÿ0.0ÿ66ÿ0.0ÿ67ÿ0.0ÿ68ÿ0.0ÿ69ÿ0.0ÿ70ÿ0.0ÿ71ÿ0.0ÿ110ÿ0.0ÿ111ÿ0.0ÿ119ÿÿ116ÿDEUTSCHE SECÿ117ÿ0.44ÿ118ÿ0.45ÿ155ÿ0.0ÿ156ÿ0ÿ81ÿ0.01ÿ182ÿ0.0ÿ183ÿ0ÿ184ÿ0ÿ185ÿ0ÿ38ÿ10:11:41ÿ37ÿ10/04/17ÿ UZD3PV 061
1491894720000000000 1 060IBUSD_8Yÿ4ÿ2.148ÿ30ÿ1ÿ22ÿ0.0ÿ3ÿ2.148ÿ61ÿ2.148ÿ55ÿ-0.034ÿ56ÿ-1.5582ÿ59ÿ0.0ÿ64ÿ-0.034ÿ65ÿ-0.044ÿ66ÿ-0.259ÿ67ÿ0.697ÿ68ÿ-1.5582ÿ69ÿ-2.0073ÿ70ÿ-10.76028ÿ71ÿ48.03584ÿ17ÿ2.148ÿ18ÿ2.188ÿ38ÿ10:12:01ÿ37ÿ11/04/17ÿ IBUSD_8Y 060
1491894720000000000 1 074UZIBNVÿ139ÿ0.23ÿ140ÿ0.24ÿ141ÿ99999ÿ142ÿ100000ÿ143ÿ49.99975ÿ144ÿ50.00025ÿ UZIBNV 074
@aozoren Those sample points do not look right. I would guess the inputs you are producing are causing some error. Is there a stack trace after the line at the end of the log?
[httpd] 172.17.0.1 - root [24/Apr/2017:20:41:46 +0000] "POST /write?consistency=one&db=db1&p=%5BREDACTED%5D&precision=n&rp=autogen&u=root HTTP/1.1" 500 44 "-" "okhttp/3.5.0" 6ed9177a-292e-11e7-800c-000000000000 19789318
i got those points by issuing a select * from tick to tick series.
original data is FF separated values per line as seen with less comand:
064F_TRYUSD0516S0052.854200109:10:10.00010
064F_TRYUSD0516S0062.85240109:10:10.00010
064F_TRYUSD0516S0072.856209:10:10.00010
i parse these lines, extract 064 as type, F_TRYUSD as symbol and store the whole unparsed line as “raw” field in the point described in java code above.
i’ll look into stack trace.
I don’t see any stack trace in kitematic/docker. I see influx socket being shutdown from java client.
@aozoren That sounds like an issue with the java client, not with InfluxDB shutting down.
influxdb does shut down, i cannot bash into it after it shuts down. are you suggesting java client is causing influx container to shut down. i think java client is just reporting that container is no longer there anymore, which is true. i can provide the isolated java test code and one day worth of data ( ~1gb zipped) if you wish to take a gander.
@aozoren My first guess is still what I think the issue is. You are creating too many series in the data set and it is causing InfluxDB to crash. I would suggest cleaning up your data and figuring out exactly how many series are in your dataset.
thank you for all the help. i was under the impression i was writing one series only, which is ‘tick’. but now i realize each unique combination of tags is a series. in my case it is 6700 x 13 = 87100. the default max number of series should be 1 million so it should be possible to write 87k series. i’m guessing using docker is causing the problem, instead of installing influx on the host os. would it be possible to tweak docker to not crash under this kind of load?
i brought down the number of series to 7k and problem temporarily solved until we can commit to putting influx on its own box. thanks for all the help.
1 Like
