We had very similar issues. The version of Go that we were using doesn’t release memory which caused us a ton of issues.
Try adding this to /etc/default/influxdb
GODEBUG=madvdontneed=1
This will tell GO to release memory and you should see it decrease over time. (A service restart will be required for this to take affect)