No debug information about data ingestion

I can not see debug messages from influx. The rest is a long description of my setup but it all boils down to that simple question.

Anyhow, newie here, so it might be something obvious.

I have telegraf and influx on the same machine along with a mosquitto brocker.

telegraf is acquiring data and sending it two two different outputs one of them influx
This is the configuration…

[agent]
  ## Default data collection interval for all inputs
  interval = "1s"
  debug = true

[[inputs.mqtt_consumer]]
  servers = ["tcp://localhost:1883"]
  topics = ["some/nice/topic"]
  data_format = "json_v2"
  client_id = "telegraf32"
  [[inputs.mqtt_consumer.json_v2]]
    [[inputs.mqtt_consumer.json_v2.object]]
        path = "@this"
        timestamp_key = "Time"
        timestamp_format = "unix_ms"

[[outputs.influxdb_v2]]
  urls = ["http://localhost:8086"]
  bucket = "topic-mqtt"
  organization = "Org"
  token = "mytoken=="

[[outputs.file]]
  files = ["stdout"]

As you can see it telegraf is in debug mode, and I get debug information with journalct along with the outgoing data. Here is a small snip of the output. The most relevant is
Wrote batch of 10 metrics in 165.145847ms referring to the influx output.

Jun 23 14:54:48 DevMachine telegraf[11017]: mqtt_consumer,host=DevMachine,topic=some/nice/topic Cos=-0.5,Sin=-0.866025403784438,Sin2=-0.0151144191721904 1750690478869710000
Jun 23 14:54:48 DevMachine telegraf[11017]: mqtt_consumer,host=DevMachine,topic=some/nice/topic Cos=-0.939692620785908,Sin=0.342020143325669,Sin2=0.00596934215763363 1750690479862760000
Jun 23 14:54:48 DevMachine telegraf[11017]: mqtt_consumer,host=DevMachine,topic=some/nice/topic Cos=0.17364817766693,Sin=0.984807753012208,Sin2=0.0171872914805132 1750690480863610000
Jun 23 14:54:48 DevMachine telegraf[11017]: mqtt_consumer,host=DevMachine,topic=some/nice/topic Cos=1,Sin=0,Sin2=0 1750690481863300000
Jun 23 14:54:48 DevMachine telegraf[11017]: mqtt_consumer,host=DevMachine,topic=some/nice/topic Cos=0.17364817766693,Sin=-0.984807753012208,Sin2=-0.0171872914805132 1750690482873310000
Jun 23 14:54:48 DevMachine telegraf[11017]: mqtt_consumer,host=DevMachine,topic=some/nice/topic Cos=-0.939692620785908,Sin=-0.342020143325669,Sin2=-0.00596934215763341 1750690483870010000
Jun 23 14:54:48 DevMachine telegraf[11017]: mqtt_consumer,host=DevMachine,topic=some/nice/topic Cos=-0.5,Sin=0.866025403784439,Sin2=0.0151144191721906 1750690484869420000
Jun 23 14:54:48 DevMachine telegraf[11017]: mqtt_consumer,host=DevMachine,topic=some/nice/topic Cos=0.766044443118978,Sin=0.642787609686539,Sin2=0.0112185248482581 1750690485870550000
Jun 23 14:54:48 DevMachine telegraf[11017]: mqtt_consumer,host=DevMachine,topic=some/nice/topic Cos=0.766044443118978,Sin=-0.64278760968654,Sin2=-0.0112185248482585 1750690486866680000
Jun 23 14:54:48 DevMachine telegraf[11017]: mqtt_consumer,host=DevMachine,topic=some/nice/topic Cos=-0.5,Sin=-0.866025403784438,Sin2=-0.0151144191721904 1750690487863140000
Jun 23 14:54:48 DevMachine telegraf[11017]: 2025-06-23T12:54:48Z D! [outputs.file] Wrote batch of 10 metrics in 325.22µs
Jun 23 14:54:48 DevMachine telegraf[11017]: 2025-06-23T12:54:48Z D! [outputs.file] Buffer fullness: 0 / 10000 metrics
Jun 23 14:54:57 DevMachine telegraf[11017]: 2025-06-23T12:54:57Z D! [outputs.influxdb_v2] Wrote batch of 10 metrics in 165.145847ms
Jun 23 14:54:57 DevMachine telegraf[11017]: 2025-06-23T12:54:57Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics

On the influx side of things, even if I did enable debug in the configuration file, I don’t see anything logged with journalctl

This is my very simple config from influx server-config

user@DevMachine:~$ influx server-config
{
        "assets-path": "",
        "bolt-path": "/var/lib/influxdb/influxd.bolt",
        "e2e-testing": false,
        "engine-path": "/var/lib/influxdb/engine",
        "feature-flags": null,
        "flux-log-enabled": false,
        "hardening-enabled": false,
        "http-bind-address": ":8086",
        "http-idle-timeout": 180000000000,
        "http-read-header-timeout": 10000000000,
        "http-read-timeout": 0,
        "http-write-timeout": 0,
        "influxql-max-select-buckets": 0,
        "influxql-max-select-point": 0,
        "influxql-max-select-series": 0,
        "instance-id": "",
        "log-level": "debug",
        "metrics-disabled": false,
        "nats-max-payload-bytes": 0,
        "nats-port": 0,
        "no-tasks": false,
        "overwrite-pid-file": false,
        "pid-file": "",
        "pprof-disabled": false,
        "query-concurrency": 1024,
        "query-initial-memory-bytes": 0,
        "query-max-memory-bytes": 0,
        "query-memory-bytes": 0,
        "query-queue-size": 1024,
        "reporting-disabled": false,
        "secret-store": "bolt",
        "session-length": 60,
        "session-renew-disabled": false,
        "sqlite-path": "/var/lib/influxdb/influxd.sqlite",
        "storage-cache-max-memory-size": 1073741824,
        "storage-cache-snapshot-memory-size": 26214400,
        "storage-cache-snapshot-write-cold-duration": "10m0s",
        "storage-compact-full-write-cold-duration": "4h0m0s",
        "storage-compact-throughput-burst": 50331648,
        "storage-max-concurrent-compactions": 0,
        "storage-max-index-log-file-size": 1048576,
        "storage-no-validate-field-size": false,
        "storage-retention-check-interval": "30m0s",
        "storage-series-file-max-concurrent-snapshot-compactions": 0,
        "storage-series-id-set-cache-size": 0,
        "storage-shard-precreator-advance-period": "30m0s",
        "storage-shard-precreator-check-interval": "10m0s",
        "storage-tsm-use-madv-willneed": false,
        "storage-validate-keys": false,
        "storage-wal-flush-on-shutdown": false,
        "storage-wal-fsync-delay": "0s",
        "storage-wal-max-concurrent-writes": 0,
        "storage-wal-max-write-delay": 600000000000,
        "storage-write-timeout": 10000000000,
        "store": "disk",
        "strong-passwords": false,
        "template-file-urls-disabled": false,
        "testing-always-allow-setup": false,
        "tls-cert": "",
        "tls-key": "",
        "tls-min-version": "1.2",
        "tls-strict-ciphers": false,
        "tracing-type": "",
        "ui-disabled": false,
        "vault-addr": "",
        "vault-cacert": "",
        "vault-capath": "",
        "vault-client-cert": "",
        "vault-client-key": "",
        "vault-client-timeout": 0,
        "vault-max-retries": 0,
        "vault-skip-verify": false,
        "vault-tls-server-name": "",
        "vault-token": ""
}

So at this point I a completely puzzled. I don’t see any entries in the influx journal related to the telegraf output, and I have no clue how to see any debug information from influx. I have also attempted to use the influx tool to test the telegraf output, I get the error with invalid data, but no error when using the telegraf output, so I want to assume that influx ingested it.

user@DevMachine:~$ influx write --bucket topic-mqtt "asa"
Error: failed to write data: 400 Bad Request: unable to parse 'asa': missing fields

user@DevMachine:~$ influx write --bucket topic-mqtt mqtt_consumer,host=DevMachine,topic=some/nice/topic Cos=0.766044443118978,Sin=-0.64278760968654,Sin2=-0.0112185248482585 1750690486866680000"

Also I don’t see anything using journalctl -u influxdb output

Any hints or a piece of advice that could get me debug this?
Any idea where the debug info might be going?

Thanks in advance

A bit of extra info…

systemctl -f -u influxdb show the regular output… which ends with…

Jun 24 11:16:03 DevMachine influxd-systemd-start.sh[720]: ts=2025-06-24T09:16:03.005052Z lvl=debug msg=Request log_id=0xKJPkdG000 service=http method=GET host=localhost:8086 path=/ready query= proto=HTTP/1.1 status_code=200 response_size=106 content_length=0 referrer= remote=[::1]:44142 user_agent=curl authenticated_id= user_id= took=1.841ms body=
Jun 24 11:16:03 DevMachine systemd[1]: Started InfluxDB is an open-source, distributed, time series database.

There is nothing after that line.

I have added a different and simple input to my telegraf configuration

[[inputs.system]]
# no config

This data is seen by telegraf and sent to influx, but there is no record of ingestion on the journalctl output of influx.

However, system information is populating the bucket, while data from the mosquitto input is not… There is only the Tag, but no data at all

Here are a few lines of the output from telegraf logs…

Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine load1=0.62,load5=0.93,load15=1.03,n_cpus=8i,n_users=3i,n_unique_users=1i 1750759117708892773
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime=2641i 1750759117708892773
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime_format=" 0:44" 1750759117708892773
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine n_cpus=8i,n_users=3i,n_unique_users=1i,load1=0.62,load5=0.93,load15=1.03 1750759117818363382
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime=2641i 1750759117818363382
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime_format=" 0:44" 1750759117818363382
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine load1=0.62,load5=0.93,load15=1.03,n_cpus=8i,n_users=3i,n_unique_users=1i 1750759117974621364
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime=2642i 1750759117974621364
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime_format=" 0:44" 1750759117974621364
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine n_users=3i,n_unique_users=1i,load1=0.62,load5=0.93,load15=1.03,n_cpus=8i 1750759118018584582
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime=2642i 1750759118018584582
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime_format=" 0:44" 1750759118018584582
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine load1=0.62,load5=0.93,load15=1.03,n_cpus=8i,n_users=3i,n_unique_users=1i 1750759118108310143
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime=2642i 1750759118108310143
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime_format=" 0:44" 1750759118108310143
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine load1=0.62,load5=0.93,load15=1.03,n_cpus=8i,n_users=3i,n_unique_users=1i 1750759118207660608
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime=2642i 1750759118207660608
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime_format=" 0:44" 1750759118207660608
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine load1=0.62,load5=0.93,load15=1.03,n_cpus=8i,n_users=3i,n_unique_users=1i 1750759118311240750
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime=2642i 1750759118311240750
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime_format=" 0:44" 1750759118311240750
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine load1=0.62,load5=0.93,load15=1.03,n_cpus=8i,n_users=3i,n_unique_users=1i 1750759118408071332
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime=2642i 1750759118408071332
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime_format=" 0:44" 1750759118408071332
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine n_users=3i,n_unique_users=1i,load1=0.62,load5=0.93,load15=1.03,n_cpus=8i 1750759118504971902
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime=2642i 1750759118504971902
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime_format=" 0:44" 1750759118504971902
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine n_users=3i,n_unique_users=1i,load1=0.62,load5=0.93,load15=1.03,n_cpus=8i 1750759118605155735
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime=2642i 1750759118605155735
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime_format=" 0:44" 1750759118605155735
Jun 24 11:58:41 DevMachine telegraf[1814]: mqtt_consumer,host=DevMachine,topic=some/nice/topic Cos=0.999993674570491,Sin=0.00355679898319414 1750766318634290000
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine n_cpus=8i,n_users=3i,n_unique_users=1i,load1=0.62,load5=0.93,load15=1.03 1750759118719441911
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime=2642i 1750759118719441911
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime_format=" 0:44" 1750759118719441911
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine n_cpus=8i,n_users=3i,n_unique_users=1i,load1=0.62,load5=0.93,load15=1.03 1750759119192917478
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime=2643i 1750759119192917478
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime_format=" 0:44" 1750759119192917478
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine n_cpus=8i,n_users=3i,n_unique_users=1i,load1=1.05,load5=1.02,load15=1.06 1750759119193386211
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime=2643i 1750759119193386211
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime_format=" 0:44" 1750759119193386211
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine n_users=3i,n_unique_users=1i,load1=1.05,load5=1.02,load15=1.06,n_cpus=8i 1750759119427613970
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime=2643i 1750759119427613970
Jun 24 11:58:41 DevMachine telegraf[1814]: system,host=DevMachine uptime_format=" 0:44" 1750759119427613970
Jun 24 11:58:41 DevMachine telegraf[1814]: 2025-06-24T09:58:39Z D! [outputs.file] Wrote batch of 298 metrics in 1.876208ms
Jun 24 11:58:41 DevMachine telegraf[1814]: 2025-06-24T09:58:39Z D! [outputs.file] Buffer fullness: 0 / 10000 metrics
Jun 24 11:58:41 DevMachine telegraf[1814]: 2025-06-24T09:58:41Z D! [outputs.influxdb_v2] Wrote batch of 280 metrics in 885.630017ms
Jun 24 11:58:41 DevMachine telegraf[1814]: 2025-06-24T09:58:41Z D! [outputs.influxdb_v2] Buffer fullness: 28 / 10000 metrics

One thing I noticed is time field is a little bit off from when comparing the mosquitto retrieved data and the system input plugging.

In conclusion, it seems like influx is dropping data from the mosquitto plugin but I can not figure out the reason, and I can not get log information from influx at all.

Hello @ycdtosa,

  1. Yup you’ve enabled it succesfully!
  2. Logs are written to stdout so you should be available via journalctl -u influxdb 2. Is this a reload issue? Did you restart the service? Are you referencing the right service?
  3. You might also want to enable flux logs with:
    "flux-log-enabled": false, in your influx server config

But agreed thats odd. Maybe @skartikey has an idea or has seen this before?

→ 3. You might also want to enable flux logs with:
– > "flux-log-enabled": false, in your influx server config

Er, is that really the right syntax?

Antony.