Getting weird results from GCP europe-west1

Our operations are directly affected by the closure of these facilities and we are deeply troubled that we received zero prior notification (no emails or UI notifications). At the very least, we expect the ability to recover our data.

@Jay_Clifford we look forward to updates and (hopefully) a timely resolution.

On our end this affects as well directly our operations.
We received no email, no notifications.
I completely agree that it is unacceptable that we can’t even have access to our data.
@Jay_Clifford please provide quickly how we can achieve this data recovery.

If someone lost data and was/is on a paid plan, they should get a backup from Influx ASAP (hope they do).

As for the free plan - if you put your production servers on the free plan service - well it sucks but what are you surprised.

Is there also a way to get the backup that Influx supposedly does? Just thinking about the future :wink:

“if you put your production servers on the free plan service - well it sucks
but what are you surprised.”

This may be a reasonable statement, but it still strikes me that InfluxDB
should be making a significant effort to re-build a reputation as a responsible
and professional outfit, not only with everybody who’s been directly affected by
this, but as a brand statement in general.

Otherwise there are going to be lots of discussions in the months to come
along the lines of “how about we use InfluxDB?” “hm, weren’t those the guys
who turned off a server and deleted a whole bunch of people’s data?” "oh, yeah

  • who else can we use?"

Antony.

1 Like

I agree and didn’t want to sound like Influx didn’t do anything wrong - the way it was done wasn’t good example for others and I’m really curious how they gonna resolve that.

I received a response from their support and it’s hillarious.

TLDR: “We don’t plan to delete your data again in the forseeable future”

Full quote: “You can sign up for a new account here InfluxDB Cloud using a different region. We want to assure you that there are no more scheduled shutdowns planned. Therefore, once you have created the new account and begin writing to it, we do not foresee any data loss going forward”

1 Like

Hi all, please see the official response from Paul with regards to the situation:

What happens now?

Our engineering team is looking into whether they can restore the last 100 days of data for GCP Belgium. It appears at this time that for AWS Sydney users, the data is no longer available.

Users can reach out to our support team (support@influxdata.com) and we will begin the data retrieval and recovery process.

Paul has posted this personally in the Slack channel here. If you have questions about the next steps please comment there.

I will pick this thread back up in the morning.

Again my apologies to those that have been affected by the situation.

I have just one more question to Influx Team / Support:
Why Influx didn’t migrate data from discontinued region to any other near by region and redirect traffic from discontinued region? I have many services and majority of them would do this this way over just “discontinue and scrap”

It’s been 24 hours since I noticed our data had been deleted, and I’m still in denial about it. Multiple people from InfluxData had to make incredibly…unusual decisions for this to happen.

It’s possible people who opted out of marketing/other emails from them did not receive these notices.

Hi @Jerry1333,
Unfortunately, it’s currently not a simple process for us to merge thousands of users into new clusters. We helped manually move many of our customers who asked to move across to a new cluster. We also have to be careful legally for certain regions such as Belgium as this can be in direct violation of GDPR. Again no amount of excuses or explanations will now solve the damage caused. We are trying our best to help anyone whos been effected to continue with us if they wish to.

Hi @RoyalBlock,
If you need any support in data recovery if your using the Belgium region let me know.

Sydney unfortunately. Any updates on accessing data that was in that region?

Unfortunately @RoyalBlock at this time it does look like the data is lost for Sydney. We are still looking into it but I am 90% sure this is sadly the case.

OK, this is reasonable explanation, thank You.

I have the same problem.
No notifications or anything received; only monthly invoices, where nothing was mentioned. I subscribed to a paid solution to retain the data forever in a safe way; so I am very disappointed. No need to worry about your data safety, backup, performance, etc is one of the main reasons for a cloud subscription.

I would like to recover my data from GCP Europe-west. I have contacted support and received an answer “We are currently investigating if data can be retrieved from your account. We will keep you updated as these efforts continue.

I am also missing current data, because my IOT sensors are still trying to write to gcp-europe-west.

What is the best solution to proceed? I would like to have my historical data back, but also connect my IOT devices again. Do I need to wait for the data recovery?

Hi @webstab,
Again firstly I am ever so sorry for your loss of trust. We are still investigating the cause of why some users didn’t receive notifications. Moving forward let me help you with the next steps:

  1. Data recovery is still in process. If you where part of the Belgium customer you will receive the last 90 days of your data. Support will email you directly once this process is ready.

  2. To continue using InfluxDB Cloud you have two options. You can either sign up for a new InfluxDB Serverless Account via the account creation screen: InfluxDB Cloud . Note this will sign you up to a 3.0 account. If you are not ready to move to a 3.0 account and wish to remain on TSM let me know and I can look into that for you.

If you have a chance to jump into the community slack that also helps as we can work through any sensitive data topics via DM.

Thanks,
Jay

FYI, it was not possible for us to re-create an account with the same email.

We created a secondary account using address expansion (our main email is info@example.com, and we created an account with the address info+influx@example.com). And that works.

Hi @Julienfastre, when did you create your new account? I believe we corrected the issue this morning. My apologies you where not notified. We had posted this in slack.

My colleague created the new account yesterday morning. It was one of the first measure we take to avoid data loss with the current activity.

Happy to read that you fixed that: we will change the email address later (or not, because it perfectly works like that).

I am going to write to the support to warn them that we are only one customer behind two different accounts.

1 Like

Hi @WingsofSuspensionLif, I am really sorry we let you down. Would you mind still logging a ticket with support? We are also looking into how we refund some of the damage to the users critically affected by data loss.