Hey everyone, I’ve been back and forth through various forums, and articles on appropriate shard duration for storing stock data. I’ve seen anywhere from keeping defaults of 1week, to setting it to 50 years.
Anyone with experience on the extremes, and anything in the middle? Will having weekly create tons of shards / excessive memory usage? I’d like to get all of this data reimported into a new retention policy before it gets too large.
A. I plan on saving all historical data infinitely.
B. I’m using continuous queries with resampling to downsample data for my graphs at 1w,3d,1d,12h,6h,4h,2h,1h,30m,15m,5m,3m,1m resolutions.
C. Potentially will use realtime queries at smaller <= 15m time intervals at 12 hours per minute worth of history. For example 1m will have 12 hours of data(720 data points), 15 minute will have 180h or 7.5 days(outside of default 1week).