I have 4 edge influxdb nodes and one central node. All running influxdb docker influxdb:2.7.1
All the edge edge nodes have replication streams to the central node.
But it seems as it the replication speed is very limited.
I am logging mainly time series data, under 500 variables, one data point per second.
If I list the replication info, I see that it increases over time, but every now and then there’s a slight reduction. I’ve also seen that the data is received on the central server at about 1 second of data every 10 seconds of real time.
As can be seen between the first and second calls, there’s a decrease in the “Remaining Bytes to be Synced”.
ID Name Org ID Remote ID Local Bucket ID Remote Bucket ID Remote Bucket Name Remaining Bytes to be Synced Current Queue Bytes on Disk Max Queue Bytes Latest Status Code Drop Non-Retryable Data
MY_ID hq_replication ORG_ID REMOTE_ID LOCAL_BUCKET_ID REMOTE_BUCKET_NAME 23790925 29231555 53687091200 204 false
root@06e4762bb11d:/# influx replication list -o my_org
ID Name Org ID Remote ID Local Bucket ID Remote Bucket ID Remote Bucket Name Remaining Bytes to be Synced Current Queue Bytes on Disk Max Queue Bytes Latest Status Code Drop Non-Retryable Data
MY_ID hq_replication ORG_ID REMOTE_ID LOCAL_BUCKET_ID REMOTE_BUCKET_NAME 23791200 29231830 53687091200 204 false
root@06e4762bb11d:/# influx replication list -o my_org
ID Name Org ID Remote ID Local Bucket ID Remote Bucket ID Remote Bucket Name Remaining Bytes to be Synced Current Queue Bytes on Disk Max Queue Bytes Latest Status Code Drop Non-Retryable Data
MY_ID hq_replication ORG_ID REMOTE_ID LOCAL_BUCKET_ID REMOTE_BUCKET_NAME 23782879 29232872 53687091200 204 false
root@06e4762bb11d:/# influx replication list -o my_org
ID Name Org ID Remote ID Local Bucket ID Remote Bucket ID Remote Bucket Name Remaining Bytes to be Synced Current Queue Bytes on Disk Max Queue Bytes Latest Status Code Drop Non-Retryable Data
MY_ID hq_replication ORG_ID REMOTE_ID LOCAL_BUCKET_ID REMOTE_BUCKET_NAME 23783921 29233914 53687091200 204 false
root@06e4762bb11d:/# influx replication list -o my_org
ID Name Org ID Remote ID Local Bucket ID Remote Bucket ID Remote Bucket Name Remaining Bytes to be Synced Current Queue Bytes on Disk Max Queue Bytes Latest Status Code Drop Non-Retryable Data
MY_ID hq_replication ORG_ID REMOTE_ID LOCAL_BUCKET_ID REMOTE_BUCKET_NAME 23784959 29234952 53687091200 204 false
Both machines are idle, powerful PC’s (12 cores each), plenty of RAM and connected via cable.
My local bucket size is 64MB, aat least reported with du -h -du /var/lib/influxdb2/engine/data
.