Hello team,
I am a running a tickscript by joining data from two measurments but one of the measurments has no data.When i disable the tickscript, the memory usage becomes stable but on enabling it, kapacitor docker( where the tickscripts are running) ooms. Is there a way to let join node know that one of the measurments is empty or sparse and not wait for the data, preventing the high memory consumption?
This is the DOT graph portion of the โshowโ operation:
DOT:
digraph process_crash_restart {
graph [throughput=โ0.00 points/sโ];
stream0 [avg_exec_time_ns=โ0sโ errors=โ0โ working_cardinality=โ0โ ];
stream0 โ from2 [processed=โ2099931โ];
stream0 โ from1 [processed=โ2099931โ];
from2 [avg_exec_time_ns=โ8.594ยตsโ errors=โ0โ working_cardinality=โ0โ ];
from2 โ where3 [processed=โ2099931โ];
where3 [avg_exec_time_ns=โ15.361ยตsโ errors=โ0โ working_cardinality=โ10000โ ];
where3 โ eval4 [processed=โ699977โ];
eval4 [avg_exec_time_ns=โ145.1ยตsโ errors=โ0โ working_cardinality=โ10000โ ];
eval4 โ join14 [processed=โ699977โ];
from1 [avg_exec_time_ns=โ1.924ยตsโ errors=โ0โ working_cardinality=โ0โ ];
from1 โ eval9 [processed=โ0โ];
from1 โ elapsed6 [processed=โ0โ];
from1 โ difference5 [processed=โ0โ];
eval9 [avg_exec_time_ns=โ0sโ errors=โ0โ working_cardinality=โ0โ ];
eval9 โ join12 [processed=โ0โ];
elapsed6 [avg_exec_time_ns=โ0sโ errors=โ0โ working_cardinality=โ0โ ];
elapsed6 โ eval7 [processed=โ0โ];
eval7 [avg_exec_time_ns=โ0sโ errors=โ0โ working_cardinality=โ0โ ];
eval7 โ eval8 [processed=โ0โ];
eval8 [avg_exec_time_ns=โ0sโ errors=โ0โ working_cardinality=โ0โ ];
eval8 โ join12 [processed=โ0โ];
difference5 [avg_exec_time_ns=โ0sโ errors=โ0โ working_cardinality=โ0โ ];
difference5 โ join12 [processed=โ0โ];
join12 [avg_exec_time_ns=โ0sโ errors=โ0โ working_cardinality=โ0โ ];
join12 โ join14 [processed=โ0โ];
join14 [avg_exec_time_ns=โ28.218ยตsโ errors=โ0โ working_cardinality=โ0โ ];
join14 โ log15 [processed=โ0โ];
log15 [avg_exec_time_ns=โ0sโ errors=โ0โ working_cardinality=โ0โ ];
log15 โ alert16 [processed=โ0โ];
alert16 [alerts_inhibited=โ0โ alerts_triggered=โ0โ avg_exec_time_ns=โ0sโ crits_triggered=โ0โ errors=โ0โ infos_triggered=โ0โ oks_triggered=โ0โ warns_triggered=โ0โ working_cardinality=โ0โ ];
}