Memory leak due to join node

Hello team,

I am a running a tickscript by joining data from two measurments but one of the measurments has no data.When i disable the tickscript, the memory usage becomes stable but on enabling it, kapacitor docker( where the tickscripts are running) ooms. Is there a way to let join node know that one of the measurments is empty or sparse and not wait for the data, preventing the high memory consumption?

This is the DOT graph portion of the โ€œshowโ€ operation:
DOT:
digraph process_crash_restart {
graph [throughput=โ€œ0.00 points/sโ€];

stream0 [avg_exec_time_ns=โ€œ0sโ€ errors=โ€œ0โ€ working_cardinality=โ€œ0โ€ ];
stream0 โ†’ from2 [processed=โ€œ2099931โ€];
stream0 โ†’ from1 [processed=โ€œ2099931โ€];

from2 [avg_exec_time_ns=โ€œ8.594ยตsโ€ errors=โ€œ0โ€ working_cardinality=โ€œ0โ€ ];
from2 โ†’ where3 [processed=โ€œ2099931โ€];

where3 [avg_exec_time_ns=โ€œ15.361ยตsโ€ errors=โ€œ0โ€ working_cardinality=โ€œ10000โ€ ];
where3 โ†’ eval4 [processed=โ€œ699977โ€];

eval4 [avg_exec_time_ns=โ€œ145.1ยตsโ€ errors=โ€œ0โ€ working_cardinality=โ€œ10000โ€ ];
eval4 โ†’ join14 [processed=โ€œ699977โ€];

from1 [avg_exec_time_ns=โ€œ1.924ยตsโ€ errors=โ€œ0โ€ working_cardinality=โ€œ0โ€ ];
from1 โ†’ eval9 [processed=โ€œ0โ€];
from1 โ†’ elapsed6 [processed=โ€œ0โ€];
from1 โ†’ difference5 [processed=โ€œ0โ€];

eval9 [avg_exec_time_ns=โ€œ0sโ€ errors=โ€œ0โ€ working_cardinality=โ€œ0โ€ ];
eval9 โ†’ join12 [processed=โ€œ0โ€];

elapsed6 [avg_exec_time_ns=โ€œ0sโ€ errors=โ€œ0โ€ working_cardinality=โ€œ0โ€ ];
elapsed6 โ†’ eval7 [processed=โ€œ0โ€];

eval7 [avg_exec_time_ns=โ€œ0sโ€ errors=โ€œ0โ€ working_cardinality=โ€œ0โ€ ];
eval7 โ†’ eval8 [processed=โ€œ0โ€];

eval8 [avg_exec_time_ns=โ€œ0sโ€ errors=โ€œ0โ€ working_cardinality=โ€œ0โ€ ];
eval8 โ†’ join12 [processed=โ€œ0โ€];

difference5 [avg_exec_time_ns=โ€œ0sโ€ errors=โ€œ0โ€ working_cardinality=โ€œ0โ€ ];
difference5 โ†’ join12 [processed=โ€œ0โ€];

join12 [avg_exec_time_ns=โ€œ0sโ€ errors=โ€œ0โ€ working_cardinality=โ€œ0โ€ ];
join12 โ†’ join14 [processed=โ€œ0โ€];

join14 [avg_exec_time_ns=โ€œ28.218ยตsโ€ errors=โ€œ0โ€ working_cardinality=โ€œ0โ€ ];
join14 โ†’ log15 [processed=โ€œ0โ€];

log15 [avg_exec_time_ns=โ€œ0sโ€ errors=โ€œ0โ€ working_cardinality=โ€œ0โ€ ];
log15 โ†’ alert16 [processed=โ€œ0โ€];

alert16 [alerts_inhibited=โ€œ0โ€ alerts_triggered=โ€œ0โ€ avg_exec_time_ns=โ€œ0sโ€ crits_triggered=โ€œ0โ€ errors=โ€œ0โ€ infos_triggered=โ€œ0โ€ oks_triggered=โ€œ0โ€ warns_triggered=โ€œ0โ€ working_cardinality=โ€œ0โ€ ];
}

@Anaisdg @staff Please help

1 Like