Dynamic field names in MQTT payload with json_v2

Hi, I am new to Influx and Telegraf. I am trying to setup Telegraf to parse JSON payload from an MQTT input. The problem is my payload (not under my control) is having dynamic field values. It is a flat structure something like this below.

  'timestamp': '2024-03-19 13:09:00', 
  'SN': 'AMG2100-DEMO-001', 

  'Dynamic_Field_1': 1, 
  'Dynamic_Field_2': 'OU', 
  'Dynamic_Field_3': 'NONE', 
  'Dynamic_Field_4': 101.1, 
  'Dynamic_Field_5': 'PPB', 

The names of the fields denoted by dynamic above change from product to product although the data type remains same.

I tried the json_v2 parser as a first attempt but I think it does not support dynamic keys. Then I am trying the *XPath parser plugin with the following configuration (Also tried some variations of it). But I am getting errors such as plugin inputs.file: line 169: configuration specified the fields ["xpath"], but they were not used. This is either a typo or this config option does not exist in this version.

My telegraf config looks like this:

  servers = ["tcp://MY-MQTT-BROKER:1883"]
  ## Topics that will be subscribed to.
  topics = [

   username = "USERNAME"
   password = "PASSWORD"

  data_format = "xpath_json"
      # metric_selection = "/"
      timestamp = "time"
      timestamp_format = "2006-01-02 15:04:05Z"
      field_selection = "*"
        name   = "string('Sensor Product)"
        # device = "string('Sensor data')"

Am I expecting correct that the xpath json parser is the right plugin for my use case? If yes, then where am I going wrong? If no, is there any other alternative plugin?

Thank you very much,

I got it. By mistake, I used [inputs.file.xpath.tags] instead of [inputs.mqtt_consumer.xpath.tags]

Thank you

1 Like

@ga29 thank you for sharing your solution! I appreciate it.

1 Like