I am getting data from aws kinesis and I am pushing to influxdb. Data is separated by Venue tag, denoting Venue as a unique location. In influxdb I am calculating kpi using task which is running every hour, so what happens is there is delay in the oms which can extend from 15 min to 2 hours. So, for example I am receiving 1 tar file from each venue. Data for 11 am should come at 12 pm, however due to delay, it might go until 2 pm.
I need to run tasks in such a way that, if for any venue I am got the data, I need to calculate the kpi. How Can I do that. I thought of running tasks at 15 mins or 30 mins instead of 1 hour, but in that case the already computed Venue will again be computed.