Hai @Dmytro_Zghoba
we took incremental base backup from a docker mongo cluster in version of 4.4.18 to S3 bucket using PBM agent version 2.3.0,
while we try to restore into new mongo cluster we getting bellow error
pbm restore 2024-11-12T05:50:46Z --mongodb-uri="mongodb://admin:12345-123@drp01.info:27017,drp02.info:27017,drp3.info:27017/?replicaSet=rs1" -w
Starting restore 2024-11-12T06:26:16.076915054Z from '2024-11-12T05:50:46Z'...........................Started physical restore.
Waiting to finish......................................................................................................
.......................................................................................................
.....................................................................................................................
...........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
...............................................................................................................................................................................................................................
.................................................................................................
...............................................................................................^C
[root@drp00]# pbm logs
same continue on same for long time.
while checking with logs.
backup: 2024-11-12T05:50:46Z
2024-11-12T06:26:16Z I [rs1/drp00-mongodb01-test.dev.cloud.info:27017] [restore/2024-11-12T06:26:16.076915054Z] recovery started
2024-11-12T06:26:16Z I [rs1/drp00-mongodb03-test.dev.cloud.info:27017] got command restore [name: 2024-11-12T06:26:16.076915054Z, snapshot: 2024-11-12T05:50:46Z] <ts: 1731392776>
2024-11-12T06:26:16Z I [rs1/drp00-mongodb03-test.dev.cloud.info:27017] got epoch {1731392654 61}
2024-11-12T06:26:16Z E [rs1/drp00-mongodb03-test.dev.cloud.info:27017] [restore/2024-11-12T06:26:16.076915054Z] unable to run the restore while another backup or restore process running
2024-11-12T06:26:16Z I [rs1/drp00-mongodb01-test.dev.cloud.info:27017] [restore/2024-11-12T06:26:16.076915054Z] moving to state starting
2024-11-12T06:26:16Z I [rs1/drp00-mongodb01-test.dev.cloud.info:27017] [restore/2024-11-12T06:26:16.076915054Z] waiting for cluster
2024-11-12T06:26:16Z I [rs1/drp00-mongodb02-test.dev.cloud.info:27017] got command restore [name: 2024-11-12T06:26:16.076915054Z, snapshot: 2024-11-12T05:50:46Z] <ts: 1731392776>
2024-11-12T06:26:16Z I [rs1/drp00-mongodb02-test.dev.cloud.info:27017] got epoch {1731392654 61}
2024-11-12T06:26:16Z I [rs1/drp00-mongodb02-test.dev.cloud.info:27017] [restore/2024-11-12T06:26:16.076915054Z] backup: 2024-11-12T05:50:46Z
2024-11-12T06:26:16Z I [rs1/drp00-mongodb02-test.dev.cloud.info:27017] [restore/2024-11-12T06:26:16.076915054Z] recovery started
2024-11-12T06:26:16Z I [rs1/drp00-mongodb02-test.dev.cloud.info:27017] [restore/2024-11-12T06:26:16.076915054Z] moving to state starting
2024-11-12T06:26:16Z I [rs1/drp00-mongodb02-test.dev.cloud.info:27017] [restore/2024-11-12T06:26:16.076915054Z] waiting for cluster
2024-11-12T06:26:21Z I [rs1/drp00-mongodb03-test.dev.cloud.info:27017] [restore/2024-11-12T06:26:16.076915054Z] waiting for shards map[.pbm.restore/2024-11-12T06:26:16.076915054Z/rs.rs1/rs:{}]
2024-11-12T06:26:26Z I [rs1/drp00-mongodb03-test.dev.cloud.info:27017] [restore/2024-11-12T06:26:16.076915054Z] waiting for cluster
2024-11-12T07:05:41Z I [rs1/drp00-mongodb03-test.dev.cloud.info:27017] got command restore [name: 2024-11-12T07:05:40.841791761Z, snapshot: 2024-11-12T05:50:46Z] <ts: 1731395140>
all the service are on OK state.
rs1:
- rs1/drp00-mongodb01-test.info:27017 [S]: pbm-agent v2.3.0 OK
- rs1/drp00-mongodb02-test.info:27017 [S]: pbm-agent v2.3.0 OK
- rs1/drp00-mongodb03-test.info:27017 [P]: pbm-agent v2.3.0 OK
what will be the cause. how to restore .
I got other scenario error while trying to restore
Cluster:
========
rs1:
- rs1/drp00-mongodb01-test.dev.info:27017 [S]: pbm-agent v2.3.0 OK
- rs1/drp00-mongodb02-test.dev.info:27017 [S]: pbm-agent v2.3.0 OK
- rs1/drp00-mongodb03-test.dev.info:27017 [P]: pbm-agent v2.3.0 OK
all pbm status are healthy but while restore i am getting bellow error
[root@drp00-mongodb03-test ec2-user]# pbm restore 2024-11-12T05:50:46Z --mongodb-uri="mongodb://admin:12345-123@drp00-mongodb01-test.dev.info:27017,drp00-mongodb02-test.dev.info:27017,drp00-mongodb03-test.dev..info:27017/?replicaSet=rs1" -w
Starting restore 2024-11-12T11:09:06.708903201Z from '2024-11-12T05:50:46Z'........................................................................................................................Error: no confirmation that restore has successfully started. Replsets status:
<no replset has started restore>
after error pbm status showing as
Cluster:
========
rs1:
- rs1/drp00-mongodb01-test.dev.info:27017 [S]: pbm-agent FAILED status:
> ERROR with ERROR: lost agent, last heartbeat: 1731409715
- rs1/drp00-mongodb02-test.dev.info:27017 [S]: pbm-agent FAILED status:
> ERROR with ERROR: lost agent, last heartbeat: 1731409715
- rs1/drp00-mongodb03-test.dev.info:27017 [P]: pbm-agent FAILED status:
> ERROR with ERROR: lost agent, last heartbeat: 1731409713