Xbcloud get incorrect (truncated) files

MySQL & MariaDB
1

# xbcloud get s3://rmas/project-middleware-100/mysql-382/middleware-backup-6055 --s3-endpoint=‘http://s3.middleware.bj’ --s3-access-key=‘XXXXXX’ --s3-secret-key=‘XXXXXXXX’ --s3-region=‘Beijing’ --parallel=10 | xbstream -x -C /tmp/backup --parallel=10;

error: http request failed: Couldn’t resolve host name
error: http request failed: Couldn’t resolve host name
261020 03:32:46 xbcloud: Successfully connected.
261020 03:32:46 xbcloud: [0] Downloading project-middleware-100/mysql-382/middleware-backup-6055/xtrabackup_slave_info.00000000000000000000.
261020 03:32:46 xbcloud: [0] Downloading project-middleware-100/mysql-382/middleware-backup-6055/xtrabackup_logfile.00000000000000000000.
261020 03:32:46 xbcloud: [0] Downloading project-middleware-100/mysql-382/middleware-backup-6055/xtrabackup_tablespaces.00000000000000000000.
261020 03:32:46 xbcloud: [0] Downloading project-middleware-100/mysql-382/middleware-backup-6055/xtrabackup_info.00000000000000000000.
261020 03:32:46 xbcloud: [0] Downloading project-middleware-100/mysql-382/mi.00000000000000000000.
261020 03:32:46 xbcloud: [0] Downloading project-middleware-100/mysql-382/middlewar.00000000000000000000.
261020 03:32:46 xbcloud: [0] Downloading project-middleware-100/mysql-382/middleware-backup-6055/xtrabackup_binlog_info.00000000000000000000.
261020 03:32:46 xbcloud: [0] Downloading project-middleware-100/mysql-382/middleware-backup-6055/mysql-bin.index.00000000000000000000.
261020 03:32:46 xbcloud: [0] Downloading project-middleware-100/mysql-382/middleware-backup-6055/ib_buffer_pool.00000000000000000000.
261020 03:32:46 xbcloud: [0] Downloading project-middleware-100/mysql-382/middleware-backup-6055/ibdata1.00000000000000000000.
261020 03:32:46 xbcloud: [0] Download successfull project-middleware-100/mysql-382/middleware-backup-6055/xtrabackup_info.00000000000000000000, size 656
261020 03:32:46 xbcloud: [0] Download successfull project-middleware-100/mysql-382/middleware-backup-6055/xtrabackup_slave_info.00000000000000000000, size 35
261020 03:32:46 xbcloud: [0] Download successfull project-middleware-100/mysql-382/middleware-backup-6055/xtrabackup_tablespaces.00000000000000000000, size 95
261020 03:32:46 xbcloud: S3 error message: The specified key does not exist.
261020 03:32:46 xbcloud: [0] Download failed. Cannot download project-middleware-100/mysql-382/middlewar.00000000000000000000.
261020 03:32:46 xbcloud: S3 error message: The specified key does not exist.
261020 03:32:46 xbcloud: [0] Download failed. Cannot download project-middleware-100/mysql-382/mi.00000000000000000000.
261020 03:32:46 xbcloud: [0] Download successfull project-middleware-100/mysql-382/middleware-backup-6055/mysql-bin.index.00000000000000000000, size 68
261020 03:32:46 xbcloud: [0] Download successfull project-middleware-100/mysql-382/middleware-backup-6055/ib_buffer_pool.00000000000000000000, size 5781
261020 03:32:46 xbcloud: [0] Download successfull project-middleware-100/mysql-382/middleware-backup-6055/xtrabackup_logfile.00000000000000000000, size 5684
261020 03:32:46 xbcloud: [0] Download successfull project-middleware-100/mysql-382/middleware-backup-6055/xtrabackup_binlog_info.00000000000000000000, size 119
261020 03:32:46 xbcloud: [0] Download successfull project-middleware-100/mysql-382/middleware-backup-6055/ibdata1.00000000000000000000, size 10485801
261020 03:32:46 xbcloud: Download failed.

I use Huawei OceanStor Pacific 9540 as S3 storage

2

It seems the file is already missing or truncated. Did you verify in the S3/UI whether the files are there or not? Verify if files and folders exist in your S3 path:- aws s3 ls <s3://Bucket path/>.

Increase the –verbose option to print more details about the problem if the files still exist.

3

These are also an issue. Why couldn’t the hostname be resolved right away?

4

s3 file path with /project-middleware-100/mysql-382/middleware-backup-6055 prefix,
The following files should not appear in the Object List：
project-middleware-100/mysql-382/mi.00000000000000000000
project-middleware-100/mysql-382/middlewar.00000000000000000000

it appears that the file path has been truncated

5

Y, This domain name can be resolved by internal DNS