Hi,
i’m trying to collect data from a log file,
and push it to influxdb, for some reason the process starts but nothing happens.
this is my telegraf config file:
[[inputs.logparser]]
files = ["/var/log/centralisation/2020/03/aprprd/nodejs/api/accident-chain-api.log"]
#from_beginning = false
## Method used to watch for file updates. Can be either "inotify" or "poll".
#watch_method = "poll"
name_override = "nodejs_test"
## Parse logstash-style "grok" patterns:
[inputs.logparser.grok]
patterns = ['%{TS_UNIX:timestamp:ts-syslog} \- %{DATA:level}: \[%{DATA:component}\] %{GREEDYDATA:details} \- host="%{DATA:host}"']
custom_patterns = '''
TS_UNIX %{MONTH} %{MONTHDAY} %{HOUR}:%{MINUTE}:%{SECOND}
'''
timezone = "Europe/Paris"
this is what the log file is showing:
2020-03-10T07:58:49Z I! Starting Telegraf 1.13.4
2020-03-10T07:58:49Z D! [agent] Initializing plugins
2020-03-10T07:58:49Z D! [agent] Starting service inputs
2020-03-10T07:58:49Z D! [inputs.logparser] Tail added for file: /var/log/centralisation/2020/03/aprprd/nodejs/api/accident-chain-api.log
2020-03-10T07:58:49Z D! [inputs.logparser] Tail added for file: /var/log/centralisation/2020/03/aprprd/nodejs/api/accident-chain-api.log
2020-03-10T07:58:49Z D! [agent] Waiting for service inputs
2020-03-10T07:58:49Z D! [agent] Stopping service inputs
2020-03-10T07:58:49Z D! [inputs.logparser] Recording offset 52495 for file: /var/log/centralisation/2020/03/aprprd/nodejs/api/accident-chain-api.log
2020-03-10T07:58:49Z D! [inputs.logparser] Tail dropped for file: /var/log/centralisation/2020/03/aprprd1/nodejs/api/accident-chain-api.log
2020-03-10T07:58:49Z D! [inputs.logparser] Recording offset 52495 for file: /var/log/centralisation/2020/03/aprprd/nodejs/api/accident-chain-api.log
2020-03-10T07:58:49Z D! [inputs.logparser] Tail dropped for file: /var/log/centralisation/2020/03/aprprd/nodejs/api/accident-chain-api.log
and this is a sample from the log file:
Mar 10 08:58:36 aprprd accident-chain-api[1916]: mars 10 20 08:58:33.814, info, 5e4a92e98083a2077c96ae87, type=INFO;class=GetCurrentStepValue.java;method=a;line=27;
Mar 10 08:58:36 aprprd accident-chain-api[1916]: mars 10 20 08:58:33.824, info, 5e4a92e98083a2077c96ae87, type=INFO;class=RetrieveCurrentAccident.java;method=a;line=27;
Mar 10 08:58:36 aprprd accident-chain-api[1916]: mars 10 20 08:58:33.930, info, 5e4a92e98083a2077c96ae87, type=INFO;class=SetOncomingUserLocation.java;method=a;line=27;
Mar 10 08:58:36 aprprd accident-chain-api[1916]: mars 10 20 08:58:33.937, info, 5e4a92e98083a2077c96ae87, type=INFO;class=SetCurrentStepValue.java;method=a;line=27;output=currentStepValue : 1
Mar 10 08:58:36 aprprd accident-chain-api[1916]: mars 10 20 08:58:33.947, info, 5e4a92e98083a2077c96ae87, type=INFO;class=RetrieveCurrentAccident.java;method=a;line=27;
Mar 10 08:58:36 aprprd accident-chain-api[1916]: mars 10 20 08:58:34.840, info, 5e4a92e98083a2077c96ae87, type=INFO;class=AccidentClient.java;method=call;line=278;output=location : Location[fused 45,044156,5,674741 acc=1033 et=+3d15h28m12s278ms alt=436.0 {Bundle[mParcelledData.dataSize=52]}]