# Telegraf and influxdb configuration for ingesting bulk of data

**URL:** <https://community.influxdata.com/t/telegraf-and-influxdb-configuration-for-ingesting-bulk-of-data/21789>\
**Category:** InfluxDB 2\
**Created:** [September 21, 2021, 12:00pm UTC](https://community.influxdata.com/t/telegraf-and-influxdb-configuration-for-ingesting-bulk-of-data/21789 "2021-09-21T12:00:45Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Pratik\_Das\_Baghel](https://sea1.discourse-cdn.com/flex023/user_avatar/community.influxdata.com/pratik_das_baghel/32/5698_2.png) [@Pratik\_Das\_Baghel](https://community.influxdata.com/u/Pratik_Das_Baghel)\
**Post date:** [September 21, 2021, 12:00pm UTC](https://community.influxdata.com/t/telegraf-and-influxdb-configuration-for-ingesting-bulk-of-data/21789/1 "2021-09-21T12:00:45Z")

</div>

I am using Kafka broker as input from where i am ingesting huge bulk of data and data is coming every 5 mins. But most of metrics are getting dropped. What should i refer for ingesting this much data properly without much data loss?

Thanks

---

<div class="post-metadata">

**Author:** ![mg42561](https://avatars.discourse-cdn.com/v4/letter/m/ecae2f/32.png) [@mg42561](https://community.influxdata.com/u/mg42561)\
**Post date:** [September 21, 2021, 1:32pm UTC](https://community.influxdata.com/t/telegraf-and-influxdb-configuration-for-ingesting-bulk-of-data/21789/2 "2021-09-21T13:32:28Z")

</div>

Do you have measurements with the same timestamp and tag values? I have had issues when loading data from log files where there will be log entries with the same timestamp and tag values but different field values. Influx overwrites these and only keeps the last record. If this is your issue, you need another tag value to make the series unique (which can impact cardinality) or manipulate the timestamp slightly if you don’t need nano-second granularity you have some room to play with there.

---

<div class="post-metadata">

**Author:** ![Pratik\_Das\_Baghel](https://sea1.discourse-cdn.com/flex023/user_avatar/community.influxdata.com/pratik_das_baghel/32/5698_2.png) [@Pratik\_Das\_Baghel](https://community.influxdata.com/u/Pratik_Das_Baghel)\
**Post date:** [September 24, 2021, 4:31am UTC](https://community.influxdata.com/t/telegraf-and-influxdb-configuration-for-ingesting-bulk-of-data/21789/3 "2021-09-24T04:31:59Z")

</div>

Unique series is coming. I think making some changes in telegraf agent plugin like setting metric-batch-size or others will work. But not sure how to use them properly.