Backup error for mongo percona operator

MongoDB Percona Backup for MongoDB
1

The backup task fails.

Error:            check cluster for dump done: convergeCluster: backup on shard rs0 failed with: %!s(<nil>)

At the same time on the backup agent I can see that the backup is in progress.

2 
kubectl describe psmdb-backup test-prod-backup
Name:         test-prod-backup
Namespace:    mongo-percona
Labels:       <none>
Annotations:  <none>
API Version:  psmdb.percona.com/v1
Kind:         PerconaServerMongoDBBackup
Metadata:
  Creation Timestamp:  2024-02-19T14:06:37Z
  Finalizers:
    delete-backup
  Generation:        1
  Resource Version:  207119587
  UID:               7ff29cf5-6ac0-4140-a904-e91612aab94a
Spec:
  Cluster Name:      mongo-percona
  Compression Type:  gzip
  Storage Name:      gcs-storage-logical
  Type:              logical
Status:
  Destination:      s3://prod-mongo-backup/logical-backup/2024-02-19T14:06:58Z
  Error:            check cluster for dump done: convergeCluster: backup on shard rs0 failed with: %!s(<nil>)
  Last Transition:  2024-02-19T14:34:40Z
  Pbm Name:         2024-02-19T14:06:58Z
  Pbm Pod:          10
  Replset Names:
    cfg
    rs0
  s3:
    Bucket:              prod-mongo-backup
    Credentials Secret:  gcs-credentials
    Endpoint URL:        https://storage.googleapis.com
    Max Upload Parts:    10000
    Prefix:              logical-backup
    Region:              us-central1
    Server Side Encryption:
    Storage Class:     STANDARD
    Upload Part Size:  10485760
  Start:               2024-02-19T14:06:59Z
  State:               error
  Storage Name:        gcs-storage-logical
  Type:                logical
Events:                <none>
3

I turned off pitr and another error appeared

  Error:            failed to run backup: allowUnsafeConfigurations must be true to run backup on cluster with status error
4

If I change
allowUnsafeConfigurations: false → true
then
clusterAuthMode x509 → keyFile
changes and mongos stops working.

5

Hi,

Kindly share the backup logs and let us know -

  1. Operator version
  2. PBM agent version
  3. PSMDB version.
  4. Correct me if I am wrong, backup type is logical and what is the data size on each shard.

Regards,

6

Version:
Operator 1.15
PBM 2.3.0
PSMDB 6.0.9-7
tipe backup: logical
shard 1 (size total: 1024 gb)

7

kubectl describe psmdb-backup cron-mongo-percona-20240224000000-hpxkx
Name: cron-mongo-percona-20240224000000-hpxkx
Namespace: mongo-percona
Labels: ancestor=weekly-gcs-storage-logical
cluster=mongo-percona
type=cron
Annotations:
API Version: psmdb.percona.com/v1
Kind: PerconaServerMongoDBBackup
Metadata:
Creation Timestamp: 2024-02-24T00:00:00Z
Finalizers:
delete-backup
Generate Name: cron-mongo-percona-20240224000000-
Generation: 1
Resource Version: 212858474
UID: 55784b3f-f8ed-4910-9599-ce42a858a1e5
Spec:
Cluster Name: mongo-percona
Compression Level: 6
Compression Type: gzip
Storage Name: gcs-storage-logical
Type: logical
Status:
Error: failed to run backup: allowUnsafeConfigurations must be true to run backup on cluster with status initializing
State: error
Events: