How to Read Json Streaming File via Telegraf and write Data To Influx

1

Hi,

I have been trying to read a Streaming Json File via telegraf but have been struggling with it.
Can someone please guide me as to how i can read the below Json file via telegraf and push the data to Influx DB

{“hostname”:“HostA”,“timestamp”:“2019-03-06T14:00:17.0000110Z”,“metricType”:“LightStreamerJmxServer”,“DisabledHostnamesList”:[],“DisabledIPsList”:[],“FreeMemory”:3281273456,“JavaVersion”:“1.8.0_66”,“LSClientId”:“E831673133”,“LSEdition”:“ENTERPRISE”,“LSLicenseType”:“NON-PRODUCTION-LIMITED”,“LSVersion”:“7.0.1 build 1885”,“LastRefreshTime”:“2019-03-06T14:00:16.0000196Z”,“LocalHostIP”:“127.01.01.01”,“LocalHostname”:“HostA”,“MaxMPNDevices”:null,“MaxSessions”:0,“SamplingPeriodMillis”:2000,“StartupTime”:“2019-03-06T11:55:16.0000382Z”,“Status”:“running”,“TotalMemory”:4294967296,“UptimeMillis”:7500793}
{“hostname”:“HostA”,“timestamp”:“2019-03-06T14:00:17.0000110Z”,“metricType”:“LightStreamerJmxAdapterGroup”,“adapterSetName”:“STREAMINGALL”,“adapterGroupName”:“ORDERS”,“CumulInboundEvents”:688,“CurrentItemSubscriptions”:18,“InboundEventFrequency”:0.999,“LocalPoolQueue”:-1,“MaxInboundEventFrequency”:5.0,“MaxItemSubscriptions”:23,“NewItemSubscriptions”:0,“NewItemUnsubscriptions”:0,“SubscribedButFailedItemList”:[],“SubscribedButFailedItems”:0,“SubscribedItems”:13}
{“hostname”:“HostA”,“timestamp”:“2019-03-06T14:00:17.0000110Z”,“metricType”:“LightStreamerJmxLoad”,“ActiveNIOWriteSelectors”:24,“ActivePooledThreads”:0,“AveragePoolQueueWait”:0,“CurrentNIOWriteQueue”:0,“CurrentNIOWriteQueueWait”:0,“DelayMillis”:0,“ExtraSleepMillis”:0,“ExtraWaitMillis”:0,“QueueStageEvents”:0,“QueueStageHTTPAccept”:0,“QueueStageHandshake”:0,“QueueStageMPNExecutor”:0,“QueueStageMPNNotifier”:0,“QueueStagePump”:0,“QueueStageSnapshot”:0,“ThreadPools”:[“AUTHENTICATION CITYINDEXSTREAMING”,“EVENTS”,“SNAPSHOT”,“AUTHENTICATION STREAMINGALL”,“SERVER”,“AUTHENTICATION FIXDMA”,“AUTHENTICATION STREAMINGCLIENTACCOUNT”,“AUTHENTICATION STREAMINGTRADINGACCOUNT”,“PUMP”],“TotalJVMThreads”:691,“TotalNIOSelectors”:96,“TotalPoolQueue”:0,“TotalPooledThreads”:87,“WaitingPooledThreads”:87}
{“hostname”:“HostA”,“timestamp”:“2019-03-06T14:00:17.0000110Z”,“metricType”:“LightStreamerJmxAdapterGroup”,“adapterSetName”:“STREAMINGCLIENTACCOUNT”,“adapterGroupName”:“NEWS”,“CumulInboundEvents”:0,“CurrentItemSubscriptions”:0,“InboundEventFrequency”:0.0,“LocalPoolQueue”:-1,“MaxInboundEventFrequency”:0.0,“MaxItemSubscriptions”:0,“NewItemSubscriptions”:0,“NewItemUnsubscriptions”:0,“SubscribedButFailedItemList”:[],“SubscribedButFailedItems”:0,“SubscribedItems”:0}

2

Hi i have managed to read it using the Tail input plugin but seems like its not tialing the logs

Config below. It only reads once and reads the last line and then doesnt read any more.
Any idea what i could be doing wrong here. This is on a windows server

image
image.png1145×607 15.6 KB

3

I think it is required to set watch_method = "poll" on Windows.

4

Yes thanks that worked. windows uses poll method which did the trick