Resetting alert if a service is no longer existing


i use Kapacitor to create alerts for our Mesos/Marathon microservices and forward them to Alerta. (via topics and topic-handler)
This works fine until a service which is in an alerting state gets restarted and is placed on a new host.
As the AlertID contains the hostname, no OK event is ever received for the service.
How do i get rid of the old events ? Is there a way to reset them after some time or if no new events are received ?

I’m not sure if this is the correct way…

Additional info:
All services may run on any host, even multiple services with the same name on a single host.
The only thing unique about a service is the mesos-ID which is stored in a tag.

Thanks for any help !