Steps to Backup only OPlog Slice

Jyoti_Rajai · January 4, 2023, 5:05am

Hello Team,

Query 1 :
The backing up of OPLog slice is possible with Base backup - Physical & Logical backup ?

Query 2 :
I am using PBM - 2.0.2. I wish to backup only OPlog slice & restore it.

In the documentation it says it’s possible.

"Starting with version 1.8.0, you can save oplog slices without the mandatory base backup snapshot. "

Attempt :

root@DESKTOP-L0E2A77:~# pbm list  --mongodb-uri="mongodb://pbmuser:secretpwd@localhost:27017/?authSource=admin&replicaSet=singlereplica"
Backup snapshots:
  2022-12-21T08:23:37Z <physical> [restore_to_time: 2022-12-21T08:23:38Z]
  2023-01-04T07:18:21Z <physical> [restore_to_time: 2023-01-04T07:18:24Z]
  2023-01-04T07:25:41Z <physical> [restore_to_time: 2023-01-04T07:25:44Z]

pbm config --set pitr.enabled=true  --mongodb-uri="mongodb://pbmuser:secretpwd@localhost:27017/?authSource=admin&replicaSet=singlereplica"
[pitr.enabled=true]

Logs :

2023-01-04T12:56:00.000+0530 D [pitr] start_catchup
2023-01-04T12:56:00.000+0530 E [pitr] init: catchup: no backup found. full backup is required to start PITR
2023-01-04T12:56:30.000+0530 D [pitr] start_catchup
2023-01-04T12:56:30.000+0530 E [pitr] init: catchup: no backup found. full backup is required to start PITR
2023-01-04T12:57:00.000+0530 D [pitr] start_catchup
2023-01-04T12:57:00.000+0530 E [pitr] init: catchup: no backup found. full backup is required to start PITR
2023-01-04T12:57:30.000+0530 D [pitr] start_catchup
2023-01-04T12:57:30.000+0530 E [pitr] init: catchup: no backup found. full backup is required to start PITR

Can you guide me how to perform both scenerio?

For Knowledge, I am able to take backup of Oplog over Logical backup.

Thank you in Advance.

vinicius.grippa · January 4, 2023, 6:13pm

Hi Jyoti,

Yes, it is possible to execute oplog slices backups in both methods.

With regards to the message that you are experiencing. Can you try to use the following option:

pitr:
   oplogOnly: true

It is expected to perform the oplog backup. If it does not work, please provide the MongoDB version you are using so we can test it.

Best,

Jyoti_Rajai · January 6, 2023, 6:50am

Thank you Vini for prompt response.

I was able to get backup oplog only using :

vi + /etc/pbm_config.yaml
#added below lines
pitr:
   oplogOnly: true

But I guess It’s not listed in PBM CLi List command :

root@DESKTOP-L0E2A77:~# pbm list  --mongodb-uri="mongodb://pbmuser:secretpwd@localhost:27017/?authSource=admin&replicaSet=singlereplica"
Backup snapshots:
  2023-01-06T06:43:52Z <physical> [restore_to_time: 2023-01-06T06:43:54Z]

PITR <on>:
root@DESKTOP-L0E2A77:~#

Logs from PBM-AGENT :


2023-01-06T12:07:27.000+0530 D [pitr] start_catchup [oplog only]
2023-01-06T12:07:27.000+0530 D [pitr] lastTS set to {1672987047 3} 2023-01-06T06:37:27
2023-01-06T12:07:27.000+0530 I [pitr] streaming started from 2023-01-06 06:37:27 +0000 UTC / 1672987047
2023-01-06T12:07:27.000+0530 D [pitr] start_ok

2023-01-06T12:13:52.000+0530 I got command backup [name: 2023-01-06T06:43:52Z, compression: s2 (level: default)] <ts: 1672987432>
2023-01-06T12:13:52.000+0530 I got epoch {1672987037 1}
2023-01-06T12:13:52.000+0530 I [pitr] got wake_up signal
2023-01-06T12:13:52.000+0530 D [backup/2023-01-06T06:43:52Z] init backup meta
2023-01-06T12:13:52.000+0530 I [pitr] wake_up for bcp 63b7c3286603af040376caee
2023-01-06T12:13:52.000+0530 D [backup/2023-01-06T06:43:52Z] nomination list for singlereplica: [[127.0.0.1:27017]]
2023-01-06T12:13:52.000+0530 D [backup/2023-01-06T06:43:52Z] nomination singlereplica, set candidates [127.0.0.1:27017]
2023-01-06T12:13:53.000+0530 I [backup/2023-01-06T06:43:52Z] backup started
2023-01-06T12:13:54.000+0530 D [backup/2023-01-06T06:43:52Z] backup cursor id: 06eeb136-3293-41ae-8f80-e440242d5c17
2023-01-06T12:13:55.000+0530 I [pitr] created chunk 2023-01-06T06:37:27 - 2023-01-06T06:43:53
2023-01-06T12:13:55.000+0530 I [pitr] pausing/stopping with last_ts 2023-01-06 06:43:53 +0000 UTC
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] set journal up to {1672987434 1}
2023-01-06T12:13:57.000+0530 I [backup/2023-01-06T06:43:52Z] uploading files
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/journal/WiredTigerLog.0000000032 100.00MB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/WiredTigerHS.wt 56.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/_mdb_catalog.wt 36.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-0--3371391368073350980.wt 36.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-0--4107819621118277074.wt 44.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-0-5143574458543537016.wt 36.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-0-6141969711064962041.wt 36.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-10--4107819621118277074.wt 20.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-12--4107819621118277074.wt 36.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-14--4107819621118277074.wt 2.93MB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-15--4107819621118277074.wt 24.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-17--4107819621118277074.wt 20.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-19--4107819621118277074.wt 36.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-2--3371391368073350980.wt 36.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-2-5143574458543537016.wt 36.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-2-5751740019876761316.wt 36.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-22--4107819621118277074.wt 4.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-24--4107819621118277074.wt 4.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-26--4107819621118277074.wt 4.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-27--4107819621118277074.wt 20.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-28--4107819621118277074.wt 4.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-29--4107819621118277074.wt 4.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-35--4107819621118277074.wt 4.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-38--4107819621118277074.wt 20.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-41--4107819621118277074.wt 20.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-47--4107819621118277074.wt 36.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-49--4107819621118277074.wt 164.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-5--7400535609859724419.wt 20.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-51--4107819621118277074.wt 36.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-54--4107819621118277074.wt 32.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-57--4107819621118277074.wt 36.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-60--4107819621118277074.wt 36.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-64--4107819621118277074.wt 44.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-68--4107819621118277074.wt 36.00KB
2023-01-06T12:13:57.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-70--4107819621118277074.wt 36.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/collection-8--4107819621118277074.wt 36.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-1--3371391368073350980.wt 20.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-1--4107819621118277074.wt 36.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-1-5143574458543537016.wt 20.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-1-6141969711064962041.wt 36.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-11--4107819621118277074.wt 20.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-13--4107819621118277074.wt 36.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-16--4107819621118277074.wt 24.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-18--4107819621118277074.wt 20.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-20--4107819621118277074.wt 36.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-21--4107819621118277074.wt 4.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-23--4107819621118277074.wt 4.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-25--4107819621118277074.wt 4.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-3--3371391368073350980.wt 36.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-3-5143574458543537016.wt 20.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-3-5751740019876761316.wt 36.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-30--4107819621118277074.wt 20.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-31--4107819621118277074.wt 4.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-32--4107819621118277074.wt 4.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-33--4107819621118277074.wt 4.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-34--4107819621118277074.wt 4.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-36--4107819621118277074.wt 4.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-37--4107819621118277074.wt 4.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-39--4107819621118277074.wt 20.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-4--3371391368073350980.wt 36.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-40--4107819621118277074.wt 20.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-42--4107819621118277074.wt 20.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-43--4107819621118277074.wt 20.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-48--4107819621118277074.wt 36.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-50--4107819621118277074.wt 92.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-52--4107819621118277074.wt 36.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-53--4107819621118277074.wt 36.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-55--4107819621118277074.wt 32.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-56--4107819621118277074.wt 32.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-58--4107819621118277074.wt 36.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-59--4107819621118277074.wt 36.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-6--7400535609859724419.wt 20.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-61--4107819621118277074.wt 32.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-62--4107819621118277074.wt 20.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-63--4107819621118277074.wt 32.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-65--4107819621118277074.wt 36.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-66--4107819621118277074.wt 36.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-67--4107819621118277074.wt 36.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-69--4107819621118277074.wt 20.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-71--4107819621118277074.wt 20.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/index-9--4107819621118277074.wt 20.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/sizeStorer.wt 36.00KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/WiredTiger.backup 142.66KB
2023-01-06T12:13:58.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/WiredTiger 50.00B
2023-01-06T12:13:59.000+0530 D [backup/2023-01-06T06:43:52Z] uploading: /var/lib/mongodb/journal/WiredTigerLog.0000000033 100.00MB
2023-01-06T12:13:59.000+0530 I [backup/2023-01-06T06:43:52Z] uploading done
2023-01-06T12:13:59.000+0530 D [backup/2023-01-06T06:43:52Z] stop cursor polling: <nil>, cursor err: <nil>
2023-01-06T12:13:59.000+0530 D [backup/2023-01-06T06:43:52Z] epoch set to {1672987439 6}
2023-01-06T12:14:01.000+0530 I [backup/2023-01-06T06:43:52Z] backup finished
2023-01-06T12:14:01.000+0530 D [backup/2023-01-06T06:43:52Z] releasing lock
2023-01-06T12:14:15.000+0530 D [pitr] start_catchup [oplog only]
2023-01-06T12:14:15.000+0530 D [pitr] lastTS set to {1672987433 4} 2023-01-06T06:43:53
2023-01-06T12:14:15.000+0530 I [pitr] streaming started from 2023-01-06 06:43:53 +0000 UTC / 1672987433
2023-01-06T12:14:15.000+0530 D [pitr] start_ok

Vinodh_Krishnaswamy · January 9, 2023, 3:33am

hey Jyoti,
If you still have issues, could you try resyncing with the storage and then check again (pbm status)?
pbm config --force-resync --file /etc/pbm_config.yaml

Please make sure to have parameters defined in the yaml file.

Jyoti_Rajai · January 9, 2023, 6:29am

Don’t seems to be working :

root@DESKTOP-L0E2A77:~# pbm config --force-resync --file /etc/pbm_config.yaml   --mongodb-uri="mongodb://pbmuser:secretpwd@localhost:27017/?authSource=admin&replicaSet=singlereplica"
Storage resync started

root@DESKTOP-L0E2A77:~# date
Mon Jan  9 11:31:26 IST 2023
root@DESKTOP-L0E2A77:~# pbm list  --mongodb-uri="mongodb://pbmuser:secretpwd@localhost:27017/?authSource=admin&replicaSet=singlereplica"
Backup snapshots:
  2023-01-06T06:43:52Z <physical> [restore_to_time: 2023-01-06T06:43:54Z]

PITR <on>:
root@DESKTOP-L0E2A77:~# pbm list  --mongodb-uri="mongodb://pbmuser:secretpwd@localhost:27017/?authSource=admin&replicaSet=singlereplica"
Backup snapshots:
  2023-01-06T06:43:52Z <physical> [restore_to_time: 2023-01-06T06:43:54Z]

PITR <on>:
root@DESKTOP-L0E2A77:~# date
Mon Jan  9 11:57:59 IST 2023
root@DESKTOP-L0E2A77:~#

Logs :


2023-01-09T11:30:00.000+0530 D [pitr] lastTS set to {1673243985 9} 2023-01-09T05:59:45
2023-01-09T11:30:00.000+0530 I [pitr] streaming started from 2023-01-09 05:59:45 +0000 UTC / 1673243985
2023-01-09T11:30:00.000+0530 D [pitr] start_ok
2023-01-09T11:30:20.000+0530 I got command resync <ts: 1673244020>
2023-01-09T11:30:20.000+0530 I got epoch {1673243993 1}
2023-01-09T11:30:20.000+0530 D [resync] get lock: another operation is running: PITR incremental backup ''
2023-01-09T11:30:20.000+0530 D [resync] lock not acquired
2023-01-09T11:40:03.000+0530 I [pitr] created chunk 2023-01-09T05:59:45 - 2023-01-09T06:10:00. Next chunk creation scheduled to begin at ~2023-01-09T11:50:00
2023-01-09T11:50:03.000+0530 I [pitr] created chunk 2023-01-09T06:10:00 - 2023-01-09T06:20:00. Next chunk creation scheduled to begin at ~2023-01-09T12:00:00

Jyoti_Rajai · January 9, 2023, 6:39am

Hey if I check with pbm status then it is showing me :

root@DESKTOP-L0E2A77:~# pbm status  --mongodb-uri="mongodb://pbmuser:secretpwd@localhost:27017/?authSource=admin&replicaSet=singlereplica"
Cluster:
========
singlereplica:
  - singlereplica/127.0.0.1:27017 [P]: pbm-agent v2.0.2 OK


PITR incremental backup:
========================
Status [ON]

Currently running:
==================
Snapshot backup "2023-01-09T06:32:48Z", started at 2023-01-09T06:32:49Z. Status: done. [op id: 63bbb510c308a1a167962ad1]

Backups:
========
FS  /root/backup
  Snapshots:
    2023-01-09T06:32:48Z 2.02MB <physical> [restore_to_time: 2023-01-09T06:32:51Z]
    2023-01-06T06:43:52Z 2.18MB <physical> [restore_to_time: 2023-01-06T06:43:54Z]
    2022-12-19T08:56:35Z 0.00B <physical> [ERROR: some of pbm-agents were lost during the backup] [2022-12-21T08:23:15Z]
    2022-12-15T08:27:43Z 0.00B <physical> [ERROR: some of pbm-agents were lost during the backup] [2022-12-19T08:56:36Z]
    2022-12-14T12:47:10Z 0.00B <physical> [ERROR: some of pbm-agents were lost during the backup] [2022-12-15T08:27:44Z]
    2022-12-14T12:38:32Z 0.00B <physical> [ERROR: some of pbm-agents were lost during the backup] [2022-12-14T12:47:11Z]
  PITR chunks [37.69KB]:
    2023-01-09T05:53:59Z - 2023-01-09T06:32:50Z (no base snapshot)

Jyoti_Rajai · January 9, 2023, 9:27am

@Vinodh_Krishnaswamy @vinicius.grippa , My question to you is that is there any way to find or extract oplog which are backed up using PBM.

My purpose is that if my primary node is unreachable & want to search the operation from snapshot of oplog slice & once I’ll find out the timestamp from operation. So,then can apply or recovery of that timestamp only.

vinicius.grippa · January 24, 2023, 1:21am

Hi Jyoti,

Sorry for the late reply. I checked my backups and I can see my oplog slices. In my example:

[root@vinicius-grippa-node1 20230124]# pwd
/nfs/local_backups/pbmPitr/rs0/20230124
[root@vinicius-grippa-node1 20230124]# ls -larth
total 595M
drwxr-xr-x. 3 mongod mongod 4.0K Jan 24 00:57 ..
-rw-r--r--. 1 mongod mongod  13K Jan 24 00:57 20230124005211-2.20230124005712-21.oplog.s2
-rw-r--r--. 1 mongod mongod  15K Jan 24 00:59 20230124005712-21.20230124005922-19.oplog.s2
-rw-r--r--. 1 mongod mongod 298M Jan 24 01:00 20230124005922-19.20230124010006-2.oplog.s2
-rw-r--r--. 1 mongod mongod  14K Jan 24 01:02 20230124010006-2.20230124010219-3.oplog.s2
-rw-r--r--. 1 mongod mongod 4.6K Jan 24 01:04 20230124010219-3.20230124010419-3.oplog.s2
-rw-r--r--. 1 mongod mongod 2.9K Jan 24 01:04 20230124010419-3.20230124010434-4.oplog.s2
-rw-r--r--. 1 mongod mongod 4.0K Jan 24 01:04 20230124010434-4.20230124010443-5.oplog.s2
-rw-r--r--. 1 mongod mongod 298M Jan 24 01:07 20230124010443-5.20230124010729-3.oplog.s2
drwxr-xr-x. 2 mongod mongod 4.0K Jan 24 01:09 .
-rw-r--r--. 1 mongod mongod 5.1K Jan 24 01:09 20230124010729-3.20230124010929-3.oplog.s2

But note the slices are compressed using s2 compression. You will need to do some manual work.

My purpose is that if my primary node is unreachable & want to search the operation from snapshot of oplog slice & once I’ll find out the timestamp from operation. So,then can apply or recovery of that timestamp only.

I’m not sure I follow you. To have a non-PRIMARY, it would mean you lost two nodes (from a 3-node replica set). In this situation you plan to apply the oplog until the desired PITR?

Did you try using oplog replay optionf from PBM?

For example:

$ pbm oplog-replay --start="2023-01-24T00:52:12" --end="2023-01-24T01:15:29"
Starting oplog replay '2023-01-24T00:52:12 - 2023-01-24T01:15:29'..

vinicius.grippa · January 24, 2023, 10:46pm

For the records,

To recover in situations where you ran a drop collection, you need to recover the timestamp from the logs and apply it to the oplog-reply.

For example:

rs0:PRIMARY> db.date.drop()
true
2023-01-24T19:53:18.054+0000 I COMMAND [conn512] CMD: drop percona.date
2023-01-24T19:53:18.055+0000 I STORAGE [conn512] dropCollection: percona.date (41c4ee09-a44a-43d3-9d6e-88611b6ab4ba) - storage engine will take ownership of drop-pending collection with optime { ts: Timestamp(0, 0), t: -1 } and commit timestamp Timestamp(0, 0)
2023-01-24T19:53:18.055+0000 I STORAGE [conn512] Finishing collection drop for percona.date (41c4ee09-a44a-43d3-9d6e-88611b6ab4ba).

You need to use the timestamp from the drop command.

Jyoti_Rajai · February 1, 2023, 8:49am

Hi @vinicius.grippa ,

I have tried below thing but doesn’t seems to be working for Pitr.

#------------ Below is the current status of collection :

singlereplica [direct: primary] claranet> db.sos_dba.find()
[
  { _id: ObjectId("63da0f7cfcffefb815ba7287"), Sector: 'Redis DBA' },
  { _id: ObjectId("63da0f84fcffefb815ba7288"), Sector: 'MongoDB DBA' },
  { _id: ObjectId("63da0f89fcffefb815ba7289"), Sector: 'MySQL DBA' }
]

#------------- Now I take the physical backup using PBM

CMD :

root@DESKTOP-L0E2A77:~# pbm config --set pitr.enabled=true  --mongodb-uri="mongodb://pbmuser:secretpwd@localhost:27017/?authSource=admin&replicaSet=singlereplica"
[pitr.enabled=true]
root@DESKTOP-L0E2A77:~# pbm backup --type=physical  --mongodb-uri="mongodb://pbmuser:secretpwd@localhost:27017/?authSource=admin&replicaSet=singlerepl
ica"
Starting backup '2023-02-01T07:38:18Z'...
Backup '2023-02-01T07:38:18Z' to remote store '/root/backup' has started

Logs :

2023-02-01T13:08:19.000+0530 I [backup/2023-02-01T07:38:18Z] backup started
2023-02-01T13:08:20.000+0530 D [backup/2023-02-01T07:38:18Z] backup cursor id: 2f8cfdec-8868-4856-9bd2-3248eb431f40
2023-02-01T13:08:21.000+0530 I [pitr] created chunk 2023-02-01T07:37:34 - 2023-02-01T07:38:19
2023-02-01T13:08:21.000+0530 I [pitr] pausing/stopping with last_ts 2023-02-01 07:38:19 +0000 UTC
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] set journal up to {1675237100 1}
2023-02-01T13:08:23.000+0530 I [backup/2023-02-01T07:38:18Z] uploading files
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/journal/WiredTigerLog.0000000069 100.00MB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/WiredTigerHS.wt 84.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/_mdb_catalog.wt 44.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-0--1065177456980969369.wt 36.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-0--2476177255030375037.wt 36.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-0--4107819621118277074.wt 52.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-0-6141969711064962041.wt 44.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-0-9045027585385083941.wt 36.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-10--4107819621118277074.wt 20.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-12--4107819621118277074.wt 36.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-14--4107819621118277074.wt 6.27MB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-15--4107819621118277074.wt 24.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-17--4107819621118277074.wt 20.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-19--4107819621118277074.wt 36.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-2--1065177456980969369.wt 36.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-2--2476177255030375037.wt 36.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-2-5751740019876761316.wt 36.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-22--4107819621118277074.wt 4.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-24--4107819621118277074.wt 4.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-26--4107819621118277074.wt 4.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-27--4107819621118277074.wt 20.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-28--4107819621118277074.wt 4.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-29--4107819621118277074.wt 4.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-35--4107819621118277074.wt 4.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-38--4107819621118277074.wt 20.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-41--4107819621118277074.wt 20.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-47--4107819621118277074.wt 36.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-49--4107819621118277074.wt 260.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-5--2476177255030375037.wt 20.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-5--7400535609859724419.wt 20.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-5-4811384220244075947.wt 24.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-51--4107819621118277074.wt 36.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-54--4107819621118277074.wt 36.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-57--4107819621118277074.wt 36.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-60--4107819621118277074.wt 40.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-64--4107819621118277074.wt 44.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-68--4107819621118277074.wt 36.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-7--2476177255030375037.wt 20.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-70--4107819621118277074.wt 36.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/collection-8--4107819621118277074.wt 36.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-1--1065177456980969369.wt 20.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-1--2476177255030375037.wt 20.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-1--4107819621118277074.wt 36.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-1-6141969711064962041.wt 36.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-1-9045027585385083941.wt 36.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-11--4107819621118277074.wt 20.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-13--4107819621118277074.wt 36.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-16--4107819621118277074.wt 24.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-18--4107819621118277074.wt 20.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-20--4107819621118277074.wt 36.00KB
2023-02-01T13:08:23.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-21--4107819621118277074.wt 4.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-23--4107819621118277074.wt 4.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-25--4107819621118277074.wt 4.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-3--1065177456980969369.wt 20.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-3--2476177255030375037.wt 36.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-3-5751740019876761316.wt 36.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-30--4107819621118277074.wt 20.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-31--4107819621118277074.wt 4.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-32--4107819621118277074.wt 4.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-33--4107819621118277074.wt 4.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-34--4107819621118277074.wt 4.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-36--4107819621118277074.wt 4.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-37--4107819621118277074.wt 4.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-39--4107819621118277074.wt 20.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-4--2476177255030375037.wt 36.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-40--4107819621118277074.wt 20.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-42--4107819621118277074.wt 20.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-43--4107819621118277074.wt 20.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-48--4107819621118277074.wt 36.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-50--4107819621118277074.wt 100.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-52--4107819621118277074.wt 36.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-53--4107819621118277074.wt 36.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-55--4107819621118277074.wt 36.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-56--4107819621118277074.wt 36.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-58--4107819621118277074.wt 36.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-59--4107819621118277074.wt 36.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-6--2476177255030375037.wt 20.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-6--7400535609859724419.wt 20.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-6-4811384220244075947.wt 36.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-61--4107819621118277074.wt 36.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-62--4107819621118277074.wt 36.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-63--4107819621118277074.wt 36.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-65--4107819621118277074.wt 36.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-66--4107819621118277074.wt 36.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-67--4107819621118277074.wt 36.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-69--4107819621118277074.wt 20.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-71--4107819621118277074.wt 20.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-8--2476177255030375037.wt 20.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/index-9--4107819621118277074.wt 20.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/sizeStorer.wt 44.00KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/WiredTiger.backup 157.23KB
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/WiredTiger 50.00B
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] uploading: /var/lib/mongodb/journal/WiredTigerLog.0000000070 100.00MB
2023-02-01T13:08:24.000+0530 I [backup/2023-02-01T07:38:18Z] uploading done
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] stop cursor polling: <nil>, cursor err: <nil>
2023-02-01T13:08:24.000+0530 D [backup/2023-02-01T07:38:18Z] epoch set to {1675237104 46}
2023-02-01T13:08:26.000+0530 I [backup/2023-02-01T07:38:18Z] backup finished
2023-02-01T13:08:26.000+0530 D [backup/2023-02-01T07:38:18Z] releasing lock
2023-02-01T13:08:34.000+0530 D [pitr] start_catchup [oplog only]
2023-02-01T13:08:34.000+0530 D [pitr] lastTS set to {1675237099 6} 2023-02-01T07:38:19
2023-02-01T13:08:34.000+0530 I [pitr] streaming started from 2023-02-01 07:38:19 +0000 UTC / 1675237099
2023-02-01T13:08:34.000+0530 D [pitr] start_ok
2023-02-01T13:13:36.000+0530 I [pitr] created chunk 2023-02-01T07:38:19 - 2023-02-01T07:43:34. Next chunk creation scheduled to begin at ~2023-02-01T13:18:34
2023-02-01T13:18:36.000+0530 I [pitr] created chunk 2023-02-01T07:43:34 - 2023-02-01T07:48:34. Next chunk creation scheduled to begin at ~2023-02-01T13:23:34
2023-02-01T13:21:49.000+0530 I [pitr] got done signal, stopping
2023-02-01T13:21:51.000+0530 I [pitr] created chunk 2023-02-01T07:48:34 - 2023-02-01T07:51:49
2023-02-01T13:21:51.000+0530 I [pitr] pausing/stopping with last_ts 2023-02-01 07:51:49 +0000 UTC

Logs2 :

root@DESKTOP-L0E2A77:~# pbm list  --mongodb-uri="mongodb://pbmuser:secretpwd@localhost:27017/?authSource=admin&replicaSet=singlereplica"
Backup snapshots:
  2023-01-31T11:46:26Z <physical> [restore_to_time: 2023-01-31T11:46:29Z]
  2023-02-01T07:38:18Z <physical> [restore_to_time: 2023-02-01T07:38:20Z]

PITR <on>:

root@DESKTOP-L0E2A77:~# pbm status  --mongodb-uri="mongodb://pbmuser:secretpwd@localhost:27017/?authSource=admin&replicaSet=singlereplica"
Cluster:
========
singlereplica:
  - singlereplica/127.0.0.1:27017 [P]: pbm-agent v2.0.2 OK


PITR incremental backup:
========================
Status [ON]

Currently running:
==================
(none)

Backups:
========
FS  /root/backup
  Snapshots:
    2023-02-01T07:38:18Z 2.58MB <physical> [restore_to_time: 2023-02-01T07:38:20Z]
    2023-02-01T06:26:32Z 0.00B <physical> [ERROR: some of pbm-agents were lost during the backup] [2023-02-01T07:08:01Z]
    2023-01-31T11:46:26Z 2.37MB <physical> [restore_to_time: 2023-01-31T11:46:29Z]
    2023-01-31T07:21:07Z 0.00B <physical> [ERROR: some of pbm-agents were lost during the backup] [2023-01-31T10:53:14Z]
    2023-01-31T06:29:51Z 0.00B <physical> [ERROR: some of pbm-agents were lost during the backup] [2023-01-31T06:51:33Z]
    2023-01-27T07:20:43Z 0.00B <physical> [ERROR: some of pbm-agents were lost during the backup] [2023-01-27T08:05:03Z]
    2023-01-27T06:15:38Z 0.00B <physical> [ERROR: some of pbm-agents were lost during the backup] [2023-01-27T06:39:15Z]
    2022-12-19T08:56:35Z 0.00B <physical> [ERROR: some of pbm-agents were lost during the backup] [2022-12-21T08:23:15Z]
    2022-12-15T08:27:43Z 0.00B <physical> [ERROR: some of pbm-agents were lost during the backup] [2022-12-19T08:56:36Z]
    2022-12-14T12:47:10Z 0.00B <physical> [ERROR: some of pbm-agents were lost during the backup] [2022-12-15T08:27:44Z]
    2022-12-14T12:38:32Z 0.00B <physical> [ERROR: some of pbm-agents were lost during the backup] [2022-12-14T12:47:11Z]
  PITR chunks [23.61KB]:
    2023-02-01T07:38:21Z - 2023-02-01T07:48:34Z
    2023-02-01T07:37:34Z - 2023-02-01T07:38:20Z (no base snapshot)

Note : I can see the Oplog slice in PBM status cmd but not in PBM list cmd.

#------------- Now I take the logical backup of admin schema for PBM metadata to restore it fresh machine.

root@DESKTOP-L0E2A77:~# mongodump  --db=admin  --uri="mongodb://pbmuser:secretpwd@localhost:27017/?authSource=admin&replicaSet=singlereplica" --out=/root/backup/dump_admin/
2023-02-01T13:22:13.051+0530    writing admin.system.users to /root/backup/dump_admin/admin/system.users.bson
2023-02-01T13:22:13.053+0530    done dumping admin.system.users (1 document)
2023-02-01T13:22:13.054+0530    writing admin.system.roles to /root/backup/dump_admin/admin/system.roles.bson
2023-02-01T13:22:13.055+0530    done dumping admin.system.roles (1 document)
2023-02-01T13:22:13.056+0530    writing admin.system.version to /root/backup/dump_admin/admin/system.version.bson
2023-02-01T13:22:13.058+0530    done dumping admin.system.version (2 documents)
2023-02-01T13:22:13.059+0530    writing admin.pbmLog to /root/backup/dump_admin/admin/pbmLog.bson
2023-02-01T13:22:13.060+0530    writing admin.pbmCmd to /root/backup/dump_admin/admin/pbmCmd.bson
2023-02-01T13:22:13.061+0530    writing admin.pbmOpLog to /root/backup/dump_admin/admin/pbmOpLog.bson
2023-02-01T13:22:13.061+0530    writing admin.pbmRestores to /root/backup/dump_admin/admin/pbmRestores.bson
2023-02-01T13:22:13.063+0530    done dumping admin.pbmCmd (70 documents)
2023-02-01T13:22:13.063+0530    writing admin.pbmBackups to /root/backup/dump_admin/admin/pbmBackups.bson
2023-02-01T13:22:13.063+0530    done dumping admin.pbmOpLog (63 documents)
2023-02-01T13:22:13.064+0530    done dumping admin.pbmRestores (24 documents)
2023-02-01T13:22:13.064+0530    writing admin.pbmPITRChunks to /root/backup/dump_admin/admin/pbmPITRChunks.bson
2023-02-01T13:22:13.064+0530    writing admin.pbmConfig to /root/backup/dump_admin/admin/pbmConfig.bson
2023-02-01T13:22:13.065+0530    done dumping admin.pbmPITRChunks (4 documents)
2023-02-01T13:22:13.066+0530    done dumping admin.pbmConfig (1 document)
2023-02-01T13:22:13.066+0530    done dumping admin.pbmBackups (11 documents)
2023-02-01T13:22:13.067+0530    writing admin.pbmLockOp to /root/backup/dump_admin/admin/pbmLockOp.bson
2023-02-01T13:22:13.067+0530    writing admin.pbmLock to /root/backup/dump_admin/admin/pbmLock.bson
2023-02-01T13:22:13.067+0530    writing admin.pbmAgents to /root/backup/dump_admin/admin/pbmAgents.bson
2023-02-01T13:22:13.068+0530    done dumping admin.pbmLockOp (0 documents)
2023-02-01T13:22:13.068+0530    done dumping admin.pbmLock (0 documents)
2023-02-01T13:22:13.068+0530    done dumping admin.pbmAgents (1 document)
2023-02-01T13:22:13.073+0530    done dumping admin.pbmLog (3400 documents)

#----------- Meanwhile I have inserted one record in collection between 07:38 - 07:48. So, after physical backup it’s recored in pitr oplog slice for point in time recovery after restore

singlereplica [direct: primary] claranet> db.sos_dba.insertOne({'Sector':'PostgreSQL DBA'})
{
  acknowledged: true,
  insertedId: ObjectId("63da188efcffefb815ba728a")
}
singlereplica [direct: primary] claranet> db.sos_dba.find()
[
  { _id: ObjectId("63da0f7cfcffefb815ba7287"), Sector: 'Redis DBA' },
  { _id: ObjectId("63da0f84fcffefb815ba7288"), Sector: 'MongoDB DBA' },
  { _id: ObjectId("63da0f89fcffefb815ba7289"), Sector: 'MySQL DBA' },
  {
    _id: ObjectId("63da188efcffefb815ba728a"),
    Sector: 'PostgreSQL DBA'
  }
]

#------- So, Now I intentionally do crash & start fresh instance:

root@DESKTOP-L0E2A77:~# service mongod stop
 * Stopping database mongod                                                                                                                    [ OK ]
root@DESKTOP-L0E2A77:~# rm -rf /var/lib/mongodb/*
root@DESKTOP-L0E2A77:~# service mongod start
 * Starting database mongod                                                                                                                    [ OK ]
root@DESKTOP-L0E2A77:~# mongosh
Current Mongosh Log ID: 63da1a5c23b2ef6a8ca3271d
Connecting to:          mongodb://127.0.0.1:27017/?directConnection=true&serverSelectionTimeoutMS=2000&appName=mongosh+1.6.1
Using MongoDB:          6.0.3-2
Using Mongosh:          1.6.1

For mongosh info see: https://docs.mongodb.com/mongodb-shell/

------
   The server generated these startup warnings when booting
   2023-02-01T13:22:53.092+05:30: Using the XFS filesystem is strongly recommended with the WiredTiger storage engine. See http://dochub.mongodb.org/core/prodnotes-filesystem
   2023-02-01T13:22:53.321+05:30: Access control is not enabled for the database. Read and write access to data and configuration is unrestricted. You can use percona-server-mongodb-enable-auth.sh to fix it
   2023-02-01T13:22:53.321+05:30: vm.max_map_count is too low
------

------
   Enable MongoDB's free cloud-based monitoring service, which will then receive and display
   metrics about your deployment (disk utilization, CPU, operation statistics, etc).

   The monitoring data will be available on a MongoDB website with a unique URL accessible to you
   and anyone you share the URL with. MongoDB may use this information to make product
   improvements and to suggest MongoDB products and deployment options to you.

   To enable free monitoring, run the following command: db.enableFreeMonitoring()
   To permanently disable this reminder, run the following command: db.disableFreeMonitoring()
------

test> rs.initiate()
{
  info2: 'no configuration specified. Using a default configuration for the set',
  me: '127.0.0.1:27017',
  ok: 1
}

#---------- Now to avail for PBM metadata I restore admin schema using mongodump

 root@DESKTOP-L0E2A77:~# mongorestore /root/backup/dump_admin/
2023-02-01T13:24:35.684+0530    preparing collections to restore from
2023-02-01T13:24:35.686+0530    reading metadata for admin.pbmAgents from /root/backup/dump_admin/admin/pbmAgents.metadata.json
2023-02-01T13:24:35.686+0530    reading metadata for admin.pbmCmd from /root/backup/dump_admin/admin/pbmCmd.metadata.json
2023-02-01T13:24:35.687+0530    reading metadata for admin.pbmLock from /root/backup/dump_admin/admin/pbmLock.metadata.json
2023-02-01T13:24:35.687+0530    reading metadata for admin.pbmPITRChunks from /root/backup/dump_admin/admin/pbmPITRChunks.metadata.json
2023-02-01T13:24:35.687+0530    reading metadata for admin.pbmRestores from /root/backup/dump_admin/admin/pbmRestores.metadata.json
2023-02-01T13:24:35.687+0530    reading metadata for admin.pbmBackups from /root/backup/dump_admin/admin/pbmBackups.metadata.json
2023-02-01T13:24:35.687+0530    reading metadata for admin.pbmConfig from /root/backup/dump_admin/admin/pbmConfig.metadata.json
2023-02-01T13:24:35.687+0530    reading metadata for admin.pbmLockOp from /root/backup/dump_admin/admin/pbmLockOp.metadata.json
2023-02-01T13:24:35.687+0530    reading metadata for admin.pbmLog from /root/backup/dump_admin/admin/pbmLog.metadata.json
2023-02-01T13:24:35.687+0530    reading metadata for admin.pbmOpLog from /root/backup/dump_admin/admin/pbmOpLog.metadata.json
2023-02-01T13:24:35.813+0530    restoring admin.pbmRestores from /root/backup/dump_admin/admin/pbmRestores.bson
2023-02-01T13:24:35.860+0530    finished restoring admin.pbmRestores (24 documents, 0 failures)
2023-02-01T13:24:35.860+0530    restoring admin.pbmLog from /root/backup/dump_admin/admin/pbmLog.bson
2023-02-01T13:24:35.860+0530    restoring admin.pbmBackups from /root/backup/dump_admin/admin/pbmBackups.bson
2023-02-01T13:24:35.860+0530    restoring admin.pbmOpLog from /root/backup/dump_admin/admin/pbmOpLog.bson
2023-02-01T13:24:35.892+0530    finished restoring admin.pbmBackups (11 documents, 0 failures)
2023-02-01T13:24:35.897+0530    finished restoring admin.pbmOpLog (63 documents, 0 failures)
2023-02-01T13:24:35.897+0530    restoring admin.pbmCmd from /root/backup/dump_admin/admin/pbmCmd.bson
2023-02-01T13:24:35.955+0530    finished restoring admin.pbmCmd (70 documents, 0 failures)
2023-02-01T13:24:35.956+0530    restoring admin.pbmPITRChunks from /root/backup/dump_admin/admin/pbmPITRChunks.bson
2023-02-01T13:24:35.956+0530    restoring admin.pbmConfig from /root/backup/dump_admin/admin/pbmConfig.bson
2023-02-01T13:24:35.991+0530    finished restoring admin.pbmConfig (1 document, 0 failures)
2023-02-01T13:24:35.996+0530    finished restoring admin.pbmPITRChunks (4 documents, 0 failures)
2023-02-01T13:24:35.996+0530    restoring admin.pbmAgents from /root/backup/dump_admin/admin/pbmAgents.bson
2023-02-01T13:24:36.053+0530    restoring admin.pbmLockOp from /root/backup/dump_admin/admin/pbmLockOp.bson
2023-02-01T13:24:36.053+0530    finished restoring admin.pbmAgents (1 document, 0 failures)
2023-02-01T13:24:36.054+0530    restoring admin.pbmLock from /root/backup/dump_admin/admin/pbmLock.bson
2023-02-01T13:24:36.070+0530    finished restoring admin.pbmLock (0 documents, 0 failures)
2023-02-01T13:24:36.073+0530    finished restoring admin.pbmLockOp (0 documents, 0 failures)
2023-02-01T13:24:36.092+0530    finished restoring admin.pbmLog (3400 documents, 0 failures)
2023-02-01T13:24:36.092+0530    restoring users from /root/backup/dump_admin/admin/system.users.bson
2023-02-01T13:24:36.134+0530    restoring roles from /root/backup/dump_admin/admin/system.roles.bson
2023-02-01T13:24:36.277+0530    restoring indexes for collection admin.pbmLock from metadata
2023-02-01T13:24:36.277+0530    index: &idx.IndexDocument{Options:primitive.M{"name":"replset_1", "sparse":true, "unique":true, "v":2}, Key:primitive.D{primitive.E{Key:"replset", Value:1}}, PartialFilterExpression:primitive.D(nil)}
2023-02-01T13:24:36.277+0530    restoring indexes for collection admin.pbmPITRChunks from metadata
2023-02-01T13:24:36.277+0530    index: &idx.IndexDocument{Options:primitive.M{"name":"rs_1_start_ts_1_end_ts_1", "sparse":true, "unique":true, "v":2}, Key:primitive.D{primitive.E{Key:"rs", Value:1}, primitive.E{Key:"start_ts", Value:1}, primitive.E{Key:"end_ts", Value:1}}, PartialFilterExpression:primitive.D(nil)}
2023-02-01T13:24:36.277+0530    index: &idx.IndexDocument{Options:primitive.M{"name":"start_ts_1_end_ts_1", "v":2}, Key:primitive.D{primitive.E{Key:"start_ts", Value:1}, primitive.E{Key:"end_ts", Value:1}}, PartialFilterExpression:primitive.D(nil)}
2023-02-01T13:24:36.277+0530    no indexes to restore for collection admin.pbmConfig
2023-02-01T13:24:36.277+0530    restoring indexes for collection admin.pbmOpLog from metadata
2023-02-01T13:24:36.277+0530    index: &idx.IndexDocument{Options:primitive.M{"name":"opid_1_replset_1", "sparse":true, "unique":true, "v":2}, Key:primitive.D{primitive.E{Key:"opid", Value:1}, primitive.E{Key:"replset", Value:1}}, PartialFilterExpression:primitive.D(nil)}
2023-02-01T13:24:36.277+0530    restoring indexes for collection admin.pbmLockOp from metadata
2023-02-01T13:24:36.277+0530    index: &idx.IndexDocument{Options:primitive.M{"name":"replset_1_type_1", "sparse":true, "unique":true, "v":2}, Key:primitive.D{primitive.E{Key:"replset", Value:1}, primitive.E{Key:"type", Value:1}}, PartialFilterExpression:primitive.D(nil)}
2023-02-01T13:24:36.298+0530    no indexes to restore for collection admin.pbmAgents
2023-02-01T13:24:36.298+0530    no indexes to restore for collection admin.pbmCmd
2023-02-01T13:24:36.298+0530    no indexes to restore for collection admin.pbmRestores
2023-02-01T13:24:36.298+0530    restoring indexes for collection admin.pbmBackups from metadata
2023-02-01T13:24:36.298+0530    index: &idx.IndexDocument{Options:primitive.M{"name":"name_1", "sparse":true, "unique":true, "v":2}, Key:primitive.D{primitive.E{Key:"name", Value:1}}, PartialFilterExpression:primitive.D(nil)}
2023-02-01T13:24:36.298+0530    index: &idx.IndexDocument{Options:primitive.M{"name":"start_ts_1_status_1", "v":2}, Key:primitive.D{primitive.E{Key:"start_ts", Value:1}, primitive.E{Key:"status", Value:1}}, PartialFilterExpression:primitive.D(nil)}
2023-02-01T13:24:36.479+0530    no indexes to restore for collection admin.pbmLog
2023-02-01T13:24:36.550+0530    3574 document(s) restored successfully. 0 document(s) failed to restore.

#-------- Backup is listed in pbm list

root@DESKTOP-L0E2A77:~# pbm list  --mongodb-uri="mongodb://pbmuser:secretpwd@localhost:27017/?authSource=admin&replicaSet=singlereplica"
Backup snapshots:
  2023-02-01T07:38:18Z <physical> [restore_to_time: 2023-02-01T07:38:20Z]

PITR <on>:

Jyoti_Rajai · February 1, 2023, 8:50am

#-------- Started the pbm-agent for restoration & perform restoration

root@DESKTOP-L0E2A77:~# pbm restore 2023-02-01T07:38:18Z  --mongodb-uri="mongodb://pbmuser:secretpwd@localhost:27017/?authSource=admin&replicaSet=singlereplica"
Starting restore 2023-02-01T07:55:21.006696305Z from '2023-02-01T07:38:18Z'..........................Restore of the snapshot from '2023-02-01T07:38:18Z' has started   

pbm-agent  --mongodb-uri="mongodb://pbmuser:secretpwd@localhost:27017/?authSource=admin&replicaSet=singlereplica"
2023-02-01T13:24:44.000+0530 I pbm-agent:
Version:   2.0.2
Platform:  linux/amd64
GitCommit: 3ec38a5fc6706515fb1be72b015972af1500aa17
GitBranch: release-2.0.2
BuildTime: 2022-10-24_12:16_UTC
GoVersion: go1.19
2023-02-01T13:24:44.000+0530 I starting PITR routine
2023-02-01T13:24:44.000+0530 I node: singlereplica/127.0.0.1:27017
2023-02-01T13:24:44.000+0530 I listening for the commands
2023-02-01T13:25:21.000+0530 I got command restore [name: 2023-02-01T07:55:21.006696305Z, backup name: 2023-02-01T07:38:18Z] <ts: 1675238121>
2023-02-01T13:25:21.000+0530 I got epoch {1675237901 1}
2023-02-01T13:25:21.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] backup: 2023-02-01T07:38:18Z
2023-02-01T13:25:21.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] restore started
2023-02-01T13:25:21.000+0530 D [restore/2023-02-01T07:55:21.006696305Z] port: 27631
2023-02-01T13:25:21.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] moving to state starting
2023-02-01T13:25:21.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] waiting for `starting` status in rs map[.pbm.restore/2023-02-01T07:55:21.006696305Z/rs.singlereplica/node.127.0.0.1:27017:{}]
2023-02-01T13:25:26.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] waiting for shards map[.pbm.restore/2023-02-01T07:55:21.006696305Z/rs.singlereplica/rs:{}]
2023-02-01T13:25:31.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] waiting for cluster
2023-02-01T13:25:36.000+0530 D [restore/2023-02-01T07:55:21.006696305Z] converged to state starting
2023-02-01T13:25:36.000+0530 D [restore/2023-02-01T07:55:21.006696305Z] starting
2023-02-01T13:25:36.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] moving to state running
2023-02-01T13:25:36.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] waiting for `running` status in rs map[.pbm.restore/2023-02-01T07:55:21.006696305Z/rs.singlereplica/node.127.0.0.1:27017:{}]
2023-02-01T13:25:41.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] waiting for shards map[.pbm.restore/2023-02-01T07:55:21.006696305Z/rs.singlereplica/rs:{}]
2023-02-01T13:25:46.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] waiting for cluster
2023-02-01T13:25:51.000+0530 D [restore/2023-02-01T07:55:21.006696305Z] converged to state running
2023-02-01T13:25:51.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] send stopAgentC
2023-02-01T13:25:52.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] stopping mongod and flushing old data
2023-02-01T13:25:52.000+0530 D [restore/2023-02-01T07:55:21.006696305Z] shutdown server
2023-02-01T13:25:53.000+0530 D [restore/2023-02-01T07:55:21.006696305Z] waiting for the node to shutdown
2023-02-01T13:25:54.000+0530 D [restore/2023-02-01T07:55:21.006696305Z] revome old data
2023-02-01T13:25:54.000+0530 D [restore/2023-02-01T07:55:21.006696305Z] remove /var/lib/mongodb/index-7--6422090437893458676.wt
2023-02-01T13:25:54.000+0530 D [restore/2023-02-01T07:55:21.006696305Z] remove /var/lib/mongodb/collection-0--6422090437893458676.wt
2023-02-01T13:25:54.000+0530 D [restore/2023-02-01T07:55:21.006696305Z] remove /var/lib/mongodb/collection-55--6422090437893458676.wt
2023-02-01T13:25:54.000+0530 D [restore/2023-02-01T07:55:21.006696305Z] remove /var/lib/mongodb/collection-10--6422090437893458676.wt
2023-02-01T13:25:54.000+0530 D [restore/2023-02-01T07:55:21.006696305Z] remove /var/lib/mongodb/sizeStorer.wt
2023-02-01T13:25:54.000+0530 D [restore/2023-02-01T07:55:21.006696305Z] remove ***

    2023-02-01T13:25:54.000+0530 D [restore/2023-02-01T07:55:21.006696305Z] remove /var/lib/mongodb/collection-58--6422090437893458676.wt
    2023-02-01T13:25:54.000+0530 D [restore/2023-02-01T07:55:21.006696305Z] remove /var/lib/mongodb/index-11--6422090437893458676.wt
    2023-02-01T13:25:54.000+0530 D [restore/2023-02-01T07:55:21.006696305Z] remove /var/lib/mongodb/index-13--6422090437893458676.wt
    2023-02-01T13:25:54.000+0530 D [restore/2023-02-01T07:55:21.006696305Z] remove /var/lib/mongodb/index-25--6422090437893458676.wt
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copying backup data
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/journal/WiredTigerLog.0000000069.s2> to </var/lib/mongodb/journal/WiredTigerLog.0000000069>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/WiredTigerHS.wt.s2> to </var/lib/mongodb/WiredTigerHS.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/_mdb_catalog.wt.s2> to </var/lib/mongodb/_mdb_catalog.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-0--1065177456980969369.wt.s2> to </var/lib/mongodb/collection-0--1065177456980969369.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-0--2476177255030375037.wt.s2> to </var/lib/mongodb/collection-0--2476177255030375037.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-0--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-0--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-0-6141969711064962041.wt.s2> to </var/lib/mongodb/collection-0-6141969711064962041.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-0-9045027585385083941.wt.s2> to </var/lib/mongodb/collection-0-9045027585385083941.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-10--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-10--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-12--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-12--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-14--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-14--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-15--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-15--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-17--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-17--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-19--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-19--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-2--1065177456980969369.wt.s2> to </var/lib/mongodb/collection-2--1065177456980969369.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-2--2476177255030375037.wt.s2> to </var/lib/mongodb/collection-2--2476177255030375037.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-2-5751740019876761316.wt.s2> to </var/lib/mongodb/collection-2-5751740019876761316.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-22--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-22--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-24--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-24--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-26--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-26--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-27--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-27--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-28--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-28--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-29--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-29--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-35--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-35--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-38--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-38--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-41--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-41--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-47--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-47--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-49--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-49--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-5--2476177255030375037.wt.s2> to </var/lib/mongodb/collection-5--2476177255030375037.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-5--7400535609859724419.wt.s2> to </var/lib/mongodb/collection-5--7400535609859724419.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-5-4811384220244075947.wt.s2> to </var/lib/mongodb/collection-5-4811384220244075947.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-51--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-51--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-54--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-54--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-57--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-57--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-60--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-60--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-64--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-64--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-68--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-68--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-7--2476177255030375037.wt.s2> to </var/lib/mongodb/collection-7--2476177255030375037.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-70--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-70--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/collection-8--4107819621118277074.wt.s2> to </var/lib/mongodb/collection-8--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-1--1065177456980969369.wt.s2> to </var/lib/mongodb/index-1--1065177456980969369.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-1--2476177255030375037.wt.s2> to </var/lib/mongodb/index-1--2476177255030375037.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-1--4107819621118277074.wt.s2> to </var/lib/mongodb/index-1--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-1-6141969711064962041.wt.s2> to </var/lib/mongodb/index-1-6141969711064962041.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-1-9045027585385083941.wt.s2> to </var/lib/mongodb/index-1-9045027585385083941.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-11--4107819621118277074.wt.s2> to </var/lib/mongodb/index-11--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-13--4107819621118277074.wt.s2> to </var/lib/mongodb/index-13--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-16--4107819621118277074.wt.s2> to </var/lib/mongodb/index-16--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-18--4107819621118277074.wt.s2> to </var/lib/mongodb/index-18--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-20--4107819621118277074.wt.s2> to </var/lib/mongodb/index-20--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-21--4107819621118277074.wt.s2> to </var/lib/mongodb/index-21--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-23--4107819621118277074.wt.s2> to </var/lib/mongodb/index-23--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-25--4107819621118277074.wt.s2> to </var/lib/mongodb/index-25--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-3--1065177456980969369.wt.s2> to </var/lib/mongodb/index-3--1065177456980969369.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-3--2476177255030375037.wt.s2> to </var/lib/mongodb/index-3--2476177255030375037.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-3-5751740019876761316.wt.s2> to </var/lib/mongodb/index-3-5751740019876761316.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-30--4107819621118277074.wt.s2> to </var/lib/mongodb/index-30--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-31--4107819621118277074.wt.s2> to </var/lib/mongodb/index-31--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-32--4107819621118277074.wt.s2> to </var/lib/mongodb/index-32--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-33--4107819621118277074.wt.s2> to </var/lib/mongodb/index-33--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-34--4107819621118277074.wt.s2> to </var/lib/mongodb/index-34--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-36--4107819621118277074.wt.s2> to </var/lib/mongodb/index-36--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-37--4107819621118277074.wt.s2> to </var/lib/mongodb/index-37--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-39--4107819621118277074.wt.s2> to </var/lib/mongodb/index-39--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-4--2476177255030375037.wt.s2> to </var/lib/mongodb/index-4--2476177255030375037.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-40--4107819621118277074.wt.s2> to </var/lib/mongodb/index-40--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-42--4107819621118277074.wt.s2> to </var/lib/mongodb/index-42--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-43--4107819621118277074.wt.s2> to </var/lib/mongodb/index-43--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-48--4107819621118277074.wt.s2> to </var/lib/mongodb/index-48--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-50--4107819621118277074.wt.s2> to </var/lib/mongodb/index-50--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-52--4107819621118277074.wt.s2> to </var/lib/mongodb/index-52--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-53--4107819621118277074.wt.s2> to </var/lib/mongodb/index-53--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-55--4107819621118277074.wt.s2> to </var/lib/mongodb/index-55--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-56--4107819621118277074.wt.s2> to </var/lib/mongodb/index-56--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-58--4107819621118277074.wt.s2> to </var/lib/mongodb/index-58--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-59--4107819621118277074.wt.s2> to </var/lib/mongodb/index-59--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-6--2476177255030375037.wt.s2> to </var/lib/mongodb/index-6--2476177255030375037.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-6--7400535609859724419.wt.s2> to </var/lib/mongodb/index-6--7400535609859724419.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-6-4811384220244075947.wt.s2> to </var/lib/mongodb/index-6-4811384220244075947.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-61--4107819621118277074.wt.s2> to </var/lib/mongodb/index-61--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-62--4107819621118277074.wt.s2> to </var/lib/mongodb/index-62--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-63--4107819621118277074.wt.s2> to </var/lib/mongodb/index-63--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-65--4107819621118277074.wt.s2> to </var/lib/mongodb/index-65--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-66--4107819621118277074.wt.s2> to </var/lib/mongodb/index-66--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-67--4107819621118277074.wt.s2> to </var/lib/mongodb/index-67--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-69--4107819621118277074.wt.s2> to </var/lib/mongodb/index-69--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-71--4107819621118277074.wt.s2> to </var/lib/mongodb/index-71--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-8--2476177255030375037.wt.s2> to </var/lib/mongodb/index-8--2476177255030375037.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/index-9--4107819621118277074.wt.s2> to </var/lib/mongodb/index-9--4107819621118277074.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/sizeStorer.wt.s2> to </var/lib/mongodb/sizeStorer.wt>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/WiredTiger.backup.s2> to </var/lib/mongodb/WiredTiger.backup>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/WiredTiger.s2> to </var/lib/mongodb/WiredTiger>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] copy <2023-02-01T07:38:18Z/singlereplica/journal/WiredTigerLog.0000000070.s2> to </var/lib/mongodb/journal/WiredTigerLog.0000000070>
    2023-02-01T13:25:54.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] preparing data
    2023-02-01T13:25:55.000+0530 D [restore/2023-02-01T07:55:21.006696305Z] oplogTruncateAfterPoint: {1675237100 1}
    2023-02-01T13:25:56.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] recovering oplog as standalone
    2023-02-01T13:25:57.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] clean-up and reset replicaset config
    2023-02-01T13:25:58.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] restore on node succeed
    2023-02-01T13:25:58.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] moving to state done
    2023-02-01T13:25:58.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] waiting for `done` status in rs map[.pbm.restore/2023-02-01T07:55:21.006696305Z/rs.singlereplica/node.127.0.0.1:27017:{}]
    2023-02-01T13:26:03.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] waiting for shards map[.pbm.restore/2023-02-01T07:55:21.006696305Z/rs.singlereplica/rs:{}]
    2023-02-01T13:26:08.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] waiting for cluster
    2023-02-01T13:26:13.000+0530 D [restore/2023-02-01T07:55:21.006696305Z] converged to state done
    2023-02-01T13:26:13.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] writing restore meta
    2023-02-01T13:26:13.000+0530 D [restore/2023-02-01T07:55:21.006696305Z] rm tmp conf
    2023-02-01T13:26:13.000+0530 D [restore/2023-02-01T07:55:21.006696305Z] rm tmp logs
    2023-02-01T13:26:13.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] restore finished <nil>
    2023-02-01T13:26:13.000+0530 I [restore/2023-02-01T07:55:21.006696305Z] restore finished successfully
    2023-02-01T13:26:13.000+0530 I change stream was closed
    2023/02/01 13:26:13 Exit: <nil>
    2023-02-01T13:26:13.000+0530 D [restore/2023-02-01T07:55:21.006696305Z] hearbeats stopped

#-------- Started instance as well & verify the restorated data

root@DESKTOP-L0E2A77:~# chown mongod:mongod -R /var/lib/mongodb/
root@DESKTOP-L0E2A77:~# service mongod start
 * Starting database mongod                                                                                                                    [ OK ]
root@DESKTOP-L0E2A77:~# mongosh
Current Mongosh Log ID: 63da1b511391fac1c0689ced
Connecting to:          mongodb://127.0.0.1:27017/?directConnection=true&serverSelectionTimeoutMS=2000&appName=mongosh+1.6.1
Using MongoDB:          6.0.3-2
Using Mongosh:          1.6.1

For mongosh info see: https://docs.mongodb.com/mongodb-shell/

------
   The server generated these startup warnings when booting
   2023-02-01T13:26:47.300+05:30: Using the XFS filesystem is strongly recommended with the WiredTiger storage engine. See http://dochub.mongodb.org/core/prodnotes-filesystem
   2023-02-01T13:26:47.815+05:30: Access control is not enabled for the database. Read and write access to data and configuration is unrestricted. You can use percona-server-mongodb-enable-auth.sh to fix it
   2023-02-01T13:26:47.815+05:30: vm.max_map_count is too low
------

------
   Enable MongoDB's free cloud-based monitoring service, which will then receive and display
   metrics about your deployment (disk utilization, CPU, operation statistics, etc).

   The monitoring data will be available on a MongoDB website with a unique URL accessible to you
   and anyone you share the URL with. MongoDB may use this information to make product
   improvements and to suggest MongoDB products and deployment options to you.

   To enable free monitoring, run the following command: db.enableFreeMonitoring()
   To permanently disable this reminder, run the following command: db.disableFreeMonitoring()
------

singlereplica [direct: primary] test> use claranet
switched to db claranet
singlereplica [direct: primary] claranet> show collections
sos_dba
singlereplica [direct: primary] claranet> db.sos_dba.find()
[
  { _id: ObjectId("63da0f7cfcffefb815ba7287"), Sector: 'Redis DBA' },
  { _id: ObjectId("63da0f84fcffefb815ba7288"), Sector: 'MongoDB DBA' },
  { _id: ObjectId("63da0f89fcffefb815ba7289"), Sector: 'MySQL DBA' }
]

#------------ Now I do try to replay oplog but it’s doesn’t restore data

root@DESKTOP-L0E2A77:~#  pbm oplog-replay --start="2023-02-01T07:38:21" --end="2023-02-01T07:51:49" --mongodb-uri="mongodb://pbmuser:secretpwd@localhost:27017/?authSource=admin&replicaSet=singlereplica"
Starting oplog replay '2023-02-01T07:38:21 - 2023-02-01T07:51:49'...Oplog replay "2023-02-01T07:59:36.73330802Z" has started
root@DESKTOP-L0E2A77:~#

2023-02-01T13:29:37.000+0530 I got epoch {1675237036 1}
2023-02-01T13:29:37.000+0530 I [replay/2023-02-01T07:59:36.73330802Z] time: 2023-02-01T07:38:21Z-2023-02-01T07:51:49Z
2023-02-01T13:29:37.000+0530 D [replay/2023-02-01T07:59:36.73330802Z] stale lock: {Snapshot backup singlereplica 127.0.0.1:27017 63da16ea9e3069bcbcc19963 0xc00049b090}
2023-02-01T13:29:37.000+0530 D [backup] mark stale meta
2023-02-01T13:29:37.000+0530 I [replay/2023-02-01T07:59:36.73330802Z] oplog replay started
2023-02-01T13:29:37.000+0530 D [replay/2023-02-01T07:59:36.73330802Z] waiting for 'starting' status
2023-02-01T13:29:39.000+0530 I [replay/2023-02-01T07:59:36.73330802Z] oplog replay successfully finished
2023-02-01T13:29:39.000+0530 D [replay/2023-02-01T07:59:36.73330802Z] epoch set to {1675238379 2}

singlereplica [direct: primary] claranet> db.sos_dba.find()
[
  { _id: ObjectId("63da0f7cfcffefb815ba7287"), Sector: 'Redis DBA' },
  { _id: ObjectId("63da0f84fcffefb815ba7288"), Sector: 'MongoDB DBA' },
  { _id: ObjectId("63da0f89fcffefb815ba7289"), Sector: 'MySQL DBA' }
]
singlereplica [direct: primary] claranet>

Jyoti_Rajai · February 1, 2023, 8:51am

#-------- Started instance as well & verify the restorated data

root@DESKTOP-L0E2A77:~# chown mongod:mongod -R /var/lib/mongodb/
root@DESKTOP-L0E2A77:~# service mongod start
 * Starting database mongod                                                                                                                    [ OK ]
root@DESKTOP-L0E2A77:~# mongosh
Current Mongosh Log ID: 63da1b511391fac1c0689ced
Connecting to:          mongodb://127.0.0.1:27017/?directConnection=true&serverSelectionTimeoutMS=2000&appName=mongosh+1.6.1
Using MongoDB:          6.0.3-2
Using Mongosh:          1.6.1

For mongosh info see: https://docs.mongodb.com/mongodb-shell/

------
   The server generated these startup warnings when booting
   2023-02-01T13:26:47.300+05:30: Using the XFS filesystem is strongly recommended with the WiredTiger storage engine. See http://dochub.mongodb.org/core/prodnotes-filesystem
   2023-02-01T13:26:47.815+05:30: Access control is not enabled for the database. Read and write access to data and configuration is unrestricted. You can use percona-server-mongodb-enable-auth.sh to fix it
   2023-02-01T13:26:47.815+05:30: vm.max_map_count is too low
------

------
   Enable MongoDB's free cloud-based monitoring service, which will then receive and display
   metrics about your deployment (disk utilization, CPU, operation statistics, etc).

   The monitoring data will be available on a MongoDB website with a unique URL accessible to you
   and anyone you share the URL with. MongoDB may use this information to make product
   improvements and to suggest MongoDB products and deployment options to you.

   To enable free monitoring, run the following command: db.enableFreeMonitoring()
   To permanently disable this reminder, run the following command: db.disableFreeMonitoring()
------

singlereplica [direct: primary] test> use claranet
switched to db claranet
singlereplica [direct: primary] claranet> show collections
sos_dba
singlereplica [direct: primary] claranet> db.sos_dba.find()
[
  { _id: ObjectId("63da0f7cfcffefb815ba7287"), Sector: 'Redis DBA' },
  { _id: ObjectId("63da0f84fcffefb815ba7288"), Sector: 'MongoDB DBA' },
  { _id: ObjectId("63da0f89fcffefb815ba7289"), Sector: 'MySQL DBA' }
]

#------------ Now I do try to replay oplog but it’s doesn’t restore data

root@DESKTOP-L0E2A77:~#  pbm oplog-replay --start="2023-02-01T07:38:21" --end="2023-02-01T07:51:49" --mongodb-uri="mongodb://pbmuser:secretpwd@localhost:27017/?authSource=admin&replicaSet=singlereplica"
Starting oplog replay '2023-02-01T07:38:21 - 2023-02-01T07:51:49'...Oplog replay "2023-02-01T07:59:36.73330802Z" has started
root@DESKTOP-L0E2A77:~#

2023-02-01T13:29:37.000+0530 I got epoch {1675237036 1}
2023-02-01T13:29:37.000+0530 I [replay/2023-02-01T07:59:36.73330802Z] time: 2023-02-01T07:38:21Z-2023-02-01T07:51:49Z
2023-02-01T13:29:37.000+0530 D [replay/2023-02-01T07:59:36.73330802Z] stale lock: {Snapshot backup singlereplica 127.0.0.1:27017 63da16ea9e3069bcbcc19963 0xc00049b090}
2023-02-01T13:29:37.000+0530 D [backup] mark stale meta
2023-02-01T13:29:37.000+0530 I [replay/2023-02-01T07:59:36.73330802Z] oplog replay started
2023-02-01T13:29:37.000+0530 D [replay/2023-02-01T07:59:36.73330802Z] waiting for 'starting' status
2023-02-01T13:29:39.000+0530 I [replay/2023-02-01T07:59:36.73330802Z] oplog replay successfully finished
2023-02-01T13:29:39.000+0530 D [replay/2023-02-01T07:59:36.73330802Z] epoch set to {1675238379 2}

singlereplica [direct: primary] claranet> db.sos_dba.find()
[
  { _id: ObjectId("63da0f7cfcffefb815ba7287"), Sector: 'Redis DBA' },
  { _id: ObjectId("63da0f84fcffefb815ba7288"), Sector: 'MongoDB DBA' },
  { _id: ObjectId("63da0f89fcffefb815ba7289"), Sector: 'MySQL DBA' }
]
singlereplica [direct: primary] claranet>

Topic		Replies	Views
How to properly use oplogOnly with physical backups? Percona Backup for MongoDB	6	742	September 21, 2023
Is there a way to determine to which specific snapshot does an oplog slice belongs to? Percona Backup for MongoDB percona , mongodb	1	515	June 15, 2021
Percona backup for MongoDB no PITR chunks during full backup? Percona Backup for MongoDB	2	664	September 6, 2022
Percona PITR makes oplog slices invalid as per docs Percona Backup for MongoDB	2	533	April 13, 2021
No base snapshot Percona Backup for MongoDB	2	597	June 29, 2022

Steps to Backup only OPlog Slice

Related topics