Hi, i am using Kinesis consumer as input plugin. However i am not seeing option for having multiple consumer for same kinesis stream as we have option for kafka consumer plugin. Like for kinesis we can have multiple shard from source side but for client side i was not able to find any configuration for consumer. Is there any option for that.
Hi,
It doesn’t look like there is currently an option for that. My suggestion would be to define multiple [[inputs.kinesis_consumer]] sections for each stream name you want to monitor.
Out of curiosity, how many streams are you after?
Yeah so i am using the same approach as you told 4 kinesis consumer plugins for 4 kinesis stream, but i think i would need to separate them out as we are not able to prevent metrics from getting dropped, whenever once in a while huge volume of data comes.
