Xbcloud can not list items on gcloud buckets

General Questions
,
1

Hi, this is my first post, so i do apologize if i make some mistakes on following the forum rules. I’ll do my best.

I have a percona cluster on GKE and a valid and tested mysql backup residing on it. When i launch
xbcloud get s3://mybucket/full-2021-01-01_23-00-01.xbstream --parallel=10 --s3-region=us-central1 --s3-endpoint=https://storage.googleapis.com --s3-access-key=xxxxx --s3-secret-key=xxxxx
(credentials regarding a valid service account with bucket admin access)
i get
220118 12:24:59 xbcloud: Successfully connected. 220118 12:25:00 xbcloud: Download failed. Cannot list full-2021-01-01_23-00-01.xbstream.
despite the file is on the bucket.
Any help will be much appreciated.
Thank you!

1 Like
2

Hi @Jaume_Rodriguez .
Welcome to our forum!

xbcloud expects to download the files placed on a backup folder. It will download all the files on it. From what I can see, you are trying to download a single file named full-2021-01-01_23-00-01.xbstream .

Can you show us which command did you used to upload the files?

1 Like
3

The file was transferred between buckets from different projects on gcloud, and the origin as far as i know can be restored outside GKE on a regular instance. So i don’t know which was the command but the backup file is right and this is the only file on the bucket. I can download it to a local storage through “manual” downloading on the gcloud console. Its size is ~200Gb.

1 Like
4

Add the file to a specific folder like /mybucket/my_backup and then on xbcloud pass:

xbcloud get s3://mybucket/my_backup --parallel=10 --s3-region=us-central1 --s3-endpoint=https://storage.googleapis.com --s3-access-key=xxxxx --s3-secret-key=xxxxx
1 Like
5

it still does not work, but what is more disturbing is that trying that command without file, just only the path, it completes with a custom filename -with date and 000- and returns a file not found from the api.
Downloading back/full-2022-01.00000000000000000000. 220118 14:09:11 xbcloud: Failed to download object mybucket/back/full-2022-01.00000000000000000000. Error message: <?xml version='1.0' encoding='UTF-8'?><Error><Code>NoSuchKey</Code><Message>The specified key does not exist.</Message><Details>No such object: mybucket/back/full-2022-01.00000000000000000000</Details></Error>

So i guess that it can list files on mybucket because otherwise it would not throw this message.

1 Like
6

also odd is that if i change my backup file name to full-2022-01.00000000000000000000 then the connection and download starts.

1 Like