Hi, I have a custom log file with entries as given below How to write a grok pattern to match this and output it to influxdb. I have been trying for a long time with no success. [Tue, 18 Jul 2017 02:39:45 GMT] GET 200 /lectures/questions/150 2032 47.8.10.6 [17.427 ms] phone [Tue, 18 Jul 2017…

I wrote a few tips in the logparser readme , have you seen these? I highly suggest working on your pattern one token at a time.

Thanks for the reply. I followed it and was able to find the pattern of all except timestamp. %{WORD:method} %{NUMBER:resp} %{URIPATHPARAM:request} %{NUMBER:userid} %{IPORHOST:clientip} [%{NUMBER:resptime}%{SPACE}ms] %{WORD:device} For the time I tried %{DATESTAMP_RFC2822: timestamp} but it sa…

Ok, I got the pattern. Thanks for the help. If any body needs it the pattern to match time stamp is ^[(?%{DAY}, %{MONTHDAY} %{MONTH} %{YEAR} %{TIME} GMT)]

Hi, Here is an example of my log: test.co:443 80.81.174.142 www.test.co [07/Nov/2017:09:53:34 +0200] 10524941 “GET /api/v1/company/jobs HTTP/1.1” 200 34653 “ https://www.test.co/v/hunt ” “Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3163.100 Safa…

Hi I want to filter all the logs where the status code is above 500 Please suggest me either pattern or regex to achieve this

Parse a custom log using telegraf logparser input

Telegraf

eclements June 25, 2020, 8:13pm 6

The examples in this post is now slightly outdated. For the new " grok_custom_patterns" format, see this update I wrote after not getting above 2017 examples to work in 2020 Telegraf: Custom log parsing with latest Tail Plugin, GROK and InfluxDB configuration

Topic		Replies	Views
Telegraf - inputs.logparser problems - Grok no match Telegraf influxdb , telegraf	7	5420	April 26, 2018
Got big trouble in grok patterns Telegraf telegraf	10	2628	December 6, 2018
Telegraf grok not parsing with custom patterns which works on grok debug Telegraf telegraf , grok	0	402	September 11, 2023
Custom log parsing with latest Tail Plugin, GROK and InfluxDB (Grafana ready) Telegraf influxdb , telegraf	7	16248	July 3, 2020
Parsing logs with grok Telegraf	2	622	March 14, 2019

Parse a custom log using telegraf logparser input

Related topics