Xbcloud failed to upload files to S3 for Object lock enabled

MySQL & MariaDB Percona XtraBackup
, ,
1

We are using xbcloud utility for sending backups to S3 and recently we have enabled object lock in S3 bucket and after that backups are failing. Is there any way to tackle this error ?
Command used for the same:
version - xbcloud Ver 8.0.34-29 for Linux (x86_64) (revision id: 5ba706ee)

xtrabackup --defaults-file=/etc/my.cnf --backup --user=${bkpusr} --password=${bkpswd} --socket=$sock --parallel=20 --compress --compress-threads=15 --throttle=100 --read-buffer-size=1G --stream=xbstream --incremental-basedir=${Diffbkp_basedir} --target-dir=${Target_diffdir} | xbcloud put --storage=s3 --s3-endpoint=‘s3.amazonaws.com’ --s3-access-key=${Daily_S3AccessKey} --s3-secret-key=${Daily_S3SecretKey} --s3-region=‘us-east-2’ --parallel=20 --verbose --s3-bucket=${Daily_S3Bucket} ${dtdir}_DiffBkp >>${Diffbkp_logfile} 2>&1

error:
< Content-Type: application/xml
< Transfer-Encoding: chunked
< Date: Tue, 13 Feb 2024 06:30:20 GMT
< Server: AmazonS3
< Connection: close
<

  • Closing connection 45
    240213 01:30:08 xbcloud: S3 error message: Content-MD5 OR x-amz-checksum- HTTP header is required for Put Object requests with Object Lock parameters
    240213 01:30:08 xbcloud: [0] error: failed to upload chunk: 2024-02-13-01h-30m_DiffBkp/Database/table.ibd.delta.zst.00000000000000000000, size: 95
    240213 01:30:08 xbcloud: Upload failed.
2

Hello @Sreekumar,
I don’t see anything about this AWS feature in our documentation so currently the behavior is unsupported for using object locking. You’ll need to create a new bucket without this enabled. I would also recommend that you open a feature request at https://jira.percona.com/ for XBCloud to support object locking.

1 Like