i use Kapacitor to create alerts for our Mesos/Marathon microservices and forward them to Alerta. (via topics and topic-handler)
This works fine until a service which is in an alerting state gets restarted and is placed on a new host.
As the AlertID contains the hostname, no OK event is ever received for the service.
How do i get rid of the old events ? Is there a way to reset them after some time or if no new events are received ?
I’m not sure if this is the correct way…
All services may run on any host, even multiple services with the same name on a single host.
The only thing unique about a service is the mesos-ID which is stored in a tag.
Thanks for any help !