We have a system that provides data entry on certain dates and times. You can think 2-3 days a week and at certain times of the day. Our data entries at these clocks are about 5 thousand series per second and we expect to increase. Our longest query interval is 12 hours. Our shard duration is 2 days and our retantion policy is 3 months.Our cache size configuration is cache-max-memory-size = 1073741824 and our snapshot configuration is cache-snapshot-memory-size = 26214400 and cache-snapshot-write-cold-duration = “10m0s”. Is our current configuration sufficient in such a system?
What size should I set to not get a “cache maximum memory size exceeded” error or where can I get a reference when I am configuring the cache size?
Also, do you have any suggestions for improving write and read performance?
Thank you for your advice.