InfluxDB 3 serverless: write operation fails with "Error 403 data outside of the retention period"

InfluxDB 2
, , ,
1

Hi everyone,

I am using InfluxDB 3 Serverless.
These days I am setting up the write operation to my InfluxDB cloud instance using the newer python client for influxdb 3 InfluxDB3-python-client.

Through the web portal I have set the option “Delete data” to Never to the bucket I am attempting to write in, in order to not have any retention policy restriction.

Despite this, I keep getting the error below if I try to write data having timestamp values older than one year from now.

Error exception: (403)
Reason: Forbidden
HTTP response headers: HTTPHeaderDict({'Date': 'Thu, 01 Feb 2024 11:05:48 GMT', 'Content-Type': 'application/json', 'Content-Length': '239', 'Connection': 'keep-alive', 'trace-id': '92d9f2d97d2ea1fb', 'trace-sampled': 'false', 'Strict-Transport-Security': 'max-age=15724800; includeSubDomains', 'X-Influxdb-Request-ID': '60b399b4b7d33412a6a141ecec08d27f', 'X-Influxdb-Build': 'Cloud'})
HTTP response body: {"code":"forbidden","message":"dml handler error: data in table Test is outside of the retention period: minimum acceptable timestamp is 2023-07-30T11:05:48.178479165+00:00, but observed timestamp 2022-04-04T05:40:41.079+00:00 is older."}

It seems like the minium timestamp accepted corresponds to the initial retention period I have set when the bucket was created for the first time which indeed was 6 months period.
Another detail: the bucket was initially created with HTTP API (Influx OSS API).

Do you guys have any suggestion where to look?
Do you think it is a default limitation? In this case, I couldn’t find where it is specified.

Thanks,
Nick

2

Hello @nicfio,
Hmmm yes you won’t be able to write data older than your retention policy.
If you create a new bucket with infinite retention policy then you should be able to write to that.
That’s very strange. Can you verify the retention that you have on that bucket with the api or cli and share the result?
How did you attempt to change the bucket retention policy from 6 mo to indefinite?

Can you please aslo create an issue here?

Thank you!

3

Hello @Anaisdg,

thank you for the reply.

Can you verify the retention that you have on that bucket with the api or cli and share the result?

here is the output from command line verification (influx bucket list):

{
                "createdAt": "2024-01-31T13:29:16.934100615Z",
                "description": "create bucket <name>",
                "id": "<bucketid>",
                "labels": [],
                "links": {
                        "labels": "/api/v2/buckets/##/labels",
                        "members": "/api/v2/buckets/##/members",
                        "org": "/api/v2/orgs/##",
                        "owners": "/api/v2/buckets/##/owners",
                        "self": "/api/v2/buckets##",
                        "write": "/api/v2/write?org=##"
                },
                "name": "<bucketname>",
                "orgID": "<orgid>",
                "retentionRules": [],
                "rp": "0",
                "schemaType": "implicit",
                "type": "user",
                "updatedAt": "2024-02-01T12:40:51.625915707Z"
        },

retentions rules looks empty, which means infinite time retention as I guess. Correct me If I am wrong.

How did you attempt to change the bucket retention policy from 6 mo to indefinite?

the bucket was created with initial 6 months retention time policy, then I changed it to “never” from the bucket settings in influxdb web page.

retention_never

and verified the setting is reatined.

I have opened a github issue as suggested: InfluxDB 3 serverless: write operation fails with “Error 403 data outside of the retention period" · Issue #24642 · influxdata/influxdb (github.com)

Thanks,
Nick