Xbcloud get from s3 fail

MySQL & MariaDB Percona XtraBackup
1

I can’t not get backup data from s3 to use xbcloud.

my command is

xbcloud get s3://bucket/path/
–s3-access-key=****
–s3-secret-key=****
–s3-region=****
| xbstream restore -x -C /backup/FULL/

and then i got result as like this

241024 05:27:06 xbcloud: [0] Download successfull OLD_FILE/XBK_00_FULL/undo_002.qp.00000000000000000001, size 25
241024 05:27:06 xbcloud: [0] Downloading OLD_.00000000000000000000.
241024 05:27:06 xbcloud: S3 error message: The specified key does not exist.
241024 05:27:06 xbcloud: [0] Download failed. Cannot download OLD_.00000000000000000000.
241024 05:27:06 xbcloud: Download failed.

Most weird thing is that there’s no file name as ‘OLD_.00000000000000000000.’ in my s3 bucket path.

I tried on xtrabackup version 8.0.35-31

2

Enable debug/verbose output for xbcloud and provide here please.

3

when add --verbose option i got this message

  • Connection #0 to host <my S3 url> left intact
    xbcloud: Error writing file ‘’ (OS errno 32 - Broken pipe)
    241025 02:27:56 xbcloud: [0] Download of file <my S3 path>/20241020_0000/XBK_00_FULL/undo_002.qp.00000000000000000001 failed. Cannot write to output
    241025 02:27:56 xbcloud: Download failed.

and this is log

[root@localhost backup]# cat xbcloud_log.log
xbstream: Can’t create/write to file ‘./xtrabackup_tablespaces.qp’ (OS errno 17 - File exists)
xbstream: failed to create file.
xbstream: Can’t create/write to file ‘./xtrabackup_tablespaces.qp’ (OS errno 17 - File exists)
xbstream: failed to create file.
xbstream: Can’t create/write to file ‘./xtrabackup_info.qp’ (OS errno 17 - File exists)
xbstream: failed to create file.
xbstream: Can’t create/write to file ‘./xtrabackup_info.qp’ (OS errno 17 - File exists)
xbstream: failed to create file.
xbstream: Can’t create/write to file ‘./undo_002.qp’ (OS errno 17 - File exists)
xbstream: failed to create file.
exit code: 1

when I did “xbcloud get” from same bucket but different path using same S3 key, it works. but some path cannot.

4

This is pretty telling what the problem is. You are trying to pull files from S3 and they already exist locally. Remove any local files first, then try again.

5

it’s same when i set the empty dir for target dir

as i said at the first question
the thing is that xbcloud trying to download file in wrong path.

  • Mark bundle as not supporting multiuse
    < HTTP/1.1 404 Not Found
    < x-amz-request-id: DA3MS8WSJ882KVFG
    < x-amz-id-2: vjvTZ5lFB2XV7hdLS8q4tNbTFpxIiVuiHuVUWsKRa8QJ+B0riknbaZcCDaZL55N8voLp4+Nl4QjwsAJSgra5GatRR9bvhFtsJoNnkIff40o=
    < Content-Type: application/xml
    < Transfer-Encoding: chunked
    < Date: Tue, 29 Oct 2024 06:46:13 GMT
    < Server: AmazonS3
    <
  • Connection #1 to host S3 url left intact
    241029 06:46:14 xbcloud: S3 error message: The specified key does not exist.
    241029 06:46:14 xbcloud: [0] Download failed. Cannot download Backup/CREW/20241.00000000000000000000.
    241029 06:46:14 xbcloud: Download failed.

there’s no file Backup/CREW/20241.00000000000000000000. in my bucket path

my command

xbcloud --verbose get 'my s3 bucket'/Backup/CREW/20241027_0000/XBK_00_FULL/ --s3-access-key=‘xxxx’ --s3-secret-key=‘xxxx’ --s3-region=‘xxxxx’ | xbstream restore -x -C /backup/FULL/ --parallel=5 >> /backup/xbcloud_log.log 2>&1

6

Since the file does not exist, please use aws s3 ls s3://myBucket/ to find the correct path.