# Error when restore using Operator MongoDB

**URL:** <https://forums.percona.com/t/error-when-restore-using-operator-mongodb/24376>\
**Category:** Percona Operator for MongoDB\
**Tags:** pbm\
**Created:** [August 11, 2023, 7:00am UTC](https://forums.percona.com/t/error-when-restore-using-operator-mongodb/24376 "2023-08-11T07:00:34Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![dung-tien-nguyen](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/dung-tien-nguyen/32/11999_2.png) [@dung-tien-nguyen](https://forums.percona.com/u/dung-tien-nguyen)\
**Post date:** [August 11, 2023, 7:00am UTC](https://forums.percona.com/t/error-when-restore-using-operator-mongodb/24376/1 "2023-08-11T07:00:34Z")

</div>

## Description:

I am also getting error during restore.  
The process of copying files from remote storage to MongoDB pod was successful, but when mongod started, it got an error as shown below. I use the same version cluster mongodb to backup and restore.

 ![image](https://us1.discourse-cdn.com/flex019/uploads/percona1/original/2X/d/d7ad08fbf660aa78ab103eaf1e84dd598c329136.png)

## Steps to Reproduce:

## Version:

I’m using:

- MongoDB Operator 1.14.0
- percona-server-mongodb:6.0.4-3
- PBM: 2.2.0

## Logs:

2023-08-11T04:05:31.000+0000 I [restore/2023-08-11T04:04:42.434647131Z] copy \<2023-08-11T02:21:21Z/rs0/index-69-3054101180844405747.wt.gz\> to \</data/db/index-69-3054101180844405747.wt\>  
2023-08-11T04:05:31.000+0000 I [restore/2023-08-11T04:04:42.434647131Z] copy \<2023-08-11T02:21:21Z/rs0/index-7-3054101180844405747.wt.gz\> to \</data/db/index-7-3054101180844405747.wt\>  
2023-08-11T04:05:31.000+0000 I [restore/2023-08-11T04:04:42.434647131Z] copy \<2023-08-11T02:21:21Z/rs0/index-74-3054101180844405747.wt.gz\> to \</data/db/index-74-3054101180844405747.wt\>  
2023-08-11T04:05:31.000+0000 I [restore/2023-08-11T04:04:42.434647131Z] copy \<2023-08-11T02:21:21Z/rs0/index-76-3054101180844405747.wt.gz\> to \</data/db/index-76-3054101180844405747.wt\>  
2023-08-11T04:05:31.000+0000 I [restore/2023-08-11T04:04:42.434647131Z] copy \<2023-08-11T02:21:21Z/rs0/index-77-3054101180844405747.wt.gz\> to \</data/db/index-77-3054101180844405747.wt\>  
2023-08-11T04:05:31.000+0000 I [restore/2023-08-11T04:04:42.434647131Z] copy \<2023-08-11T02:21:21Z/rs0/index-79-3054101180844405747.wt.gz\> to \</data/db/index-79-3054101180844405747.wt\>  
2023-08-11T04:05:31.000+0000 I [restore/2023-08-11T04:04:42.434647131Z] copy \<2023-08-11T02:21:21Z/rs0/index-9-3054101180844405747.wt.gz\> to \</data/db/index-9-3054101180844405747.wt\>  
2023-08-11T04:05:31.000+0000 I [restore/2023-08-11T04:04:42.434647131Z] copy \<2023-08-11T02:21:21Z/rs0/sizeStorer.wt.gz\> to \</data/db/sizeStorer.wt\>  
2023-08-11T04:05:31.000+0000 I [restore/2023-08-11T04:04:42.434647131Z] copy \<2023-08-11T02:21:21Z/rs0/WiredTiger.backup.gz\> to \</data/db/WiredTiger.backup\>  
2023-08-11T04:05:31.000+0000 I [restore/2023-08-11T04:04:42.434647131Z] copy \<2023-08-11T02:21:21Z/rs0/WiredTiger.gz\> to \</data/db/WiredTiger\>  
2023-08-11T04:05:31.000+0000 I [restore/2023-08-11T04:04:42.434647131Z] copy \<2023-08-11T02:21:21Z/rs0/storage.bson.gz.0-114\> to \</data/db/storage.bson\>  
2023-08-11T04:05:31.000+0000 I [restore/2023-08-11T04:04:42.434647131Z] copy \<2023-08-11T02:21:21Z/rs0/journal/WiredTigerLog.0000000002.gz\> to \</data/db/journal/WiredTigerLog.0000000002\>  
2023-08-11T04:05:31.000+0000 I [restore/2023-08-11T04:04:42.434647131Z] copy \<2023-08-11T02:21:21Z/rs0/key.db/WiredTigerLog.0000000001.gz\> to \</data/db/key.db/WiredTigerLog.0000000001\>  
2023-08-11T04:05:31.000+0000 I [restore/2023-08-11T04:04:42.434647131Z] copy \<2023-08-11T02:21:21Z/rs0/key.db/WiredTigerLog.0000000002.gz\> to \</data/db/key.db/WiredTigerLog.0000000002\>  
2023-08-11T04:05:31.000+0000 D [restore/2023-08-11T04:04:42.434647131Z] download stat: buf 1610612736, arena 268435456, span 33554432, spanNum 8, cc 6, [{1 0} {1 0} {1 0} {1 0} {1 0} {1 0}]  
2023-08-11T04:05:31.000+0000 I [restore/2023-08-11T04:04:42.434647131Z] preparing data  
2023/08/11 04:05:32 mongod process: signal: aborted (core dumped), [1691726732:305191][261:0x7f21e08ebbc0], WT\_CURSOR.next: [WT\_VERB\_EXTENSION][ERROR]: libcrypto: error:06065064:digital envelope routines:EVP\_DecryptFinal\_ex:bad decrypt:crypto/evp/evp\_enc.c:643:

[1691726732:305217][261:0x7f21e08ebbc0], WT\_CURSOR.next: [WT\_VERB\_EXTENSION][ERROR]: setting return code to WT\_PANIC  
[1691726732:305247][261:0x7f21e08ebbc0], txn-recover: [WT\_VERB\_DEFAULT][ERROR]: \_\_wt\_txn\_recover, 1125: Recovery failed: WT\_PANIC: WiredTiger library panic  
[1691726732:305598][261:0x7f21e08ebbc0], connection: [WT\_VERB\_DEFAULT][ERROR]: \_\_wt\_cache\_destroy, 364: cache server: exiting with 3 pages in memory and 0 pages evicted  
[1691726732:305617][261:0x7f21e08ebbc0], connection: [WT\_VERB\_DEFAULT][ERROR]: \_\_wt\_cache\_destroy, 371: cache server: exiting with 6566 bytes in memory  
[1691726732:305621][261:0x7f21e08ebbc0], connection: [WT\_VERB\_DEFAULT][ERROR]: \_\_wt\_cache\_destroy, 375: cache server: exiting with 6212 bytes dirty and 1 pages dirty  
[1691726732:313862][261:0x7f21e08ebbc0], WT\_CURSOR.next: [WT\_VERB\_EXTENSION][ERROR]: libcrypto: error:06065064:digital envelope routines:EVP\_DecryptFinal\_ex:bad decrypt:crypto/evp/evp\_enc.c:643:

[1691726732:313881][261:0x7f21e08ebbc0], WT\_CURSOR.next: [WT\_VERB\_EXTENSION][ERROR]: setting return code to WT\_PANIC  
[1691726732:313890][261:0x7f21e08ebbc0], txn-recover: [WT\_VERB\_DEFAULT][ERROR]: \_\_wt\_txn\_recover, 1125: Recovery failed: WT\_PANIC: WiredTiger library panic  
[1691726732:314036][261:0x7f21e08ebbc0], connection: [WT\_VERB\_DEFAULT][ERROR]: \_\_wt\_cache\_destroy, 364: cache server: exiting with 3 pages in memory and 0 pages evicted  
[1691726732:314046][261:0x7f21e08ebbc0], connection: [WT\_VERB\_DEFAULT][ERROR]: \_\_wt\_cache\_destroy, 371: cache server: exiting with 6566 bytes in memory  
[1691726732:314049][261:0x7f21e08ebbc0], connection: [WT\_VERB\_DEFAULT][ERROR]: \_\_wt\_cache\_destroy, 375: cache server: exiting with 6212 bytes dirty and 1 pages dirty  
[1691726732:321388][261:0x7f21e08ebbc0], WT\_CURSOR.next: [WT\_VERB\_EXTENSION][ERROR]: libcrypto: error:06065064:digital envelope routines:EVP\_DecryptFinal\_ex:bad decrypt:crypto/evp/evp\_enc.c:643:

[1691726732:321401][261:0x7f21e08ebbc0], WT\_CURSOR.next: [WT\_VERB\_EXTENSION][ERROR]: setting return code to WT\_PANIC  
[1691726732:321409][261:0x7f21e08ebbc0], txn-recover: [WT\_VERB\_DEFAULT][ERROR]: \_\_wt\_txn\_recover, 1125: Recovery failed: WT\_PANIC: WiredTiger library panic  
[1691726732:321590][261:0x7f21e08ebbc0], connection: [WT\_VERB\_DEFAULT][ERROR]: \_\_wt\_cache\_destroy, 364: cache server: exiting with 3 pages in memory and 0 pages evicted  
[1691726732:321600][261:0x7f21e08ebbc0], connection: [WT\_VERB\_DEFAULT][ERROR]: \_\_wt\_cache\_destroy, 371: cache server: exiting with 6566 bytes in memory  
[1691726732:321604][261:0x7f21e08ebbc0], connection: [WT\_VERB\_DEFAULT][ERROR]: \_\_wt\_cache\_destroy, 375: cache server: exiting with 6212 bytes dirty and 1 pages dirty  
2023/08/11 04:05:32 mongod log:  
{“t”:{“$date”:“2023-08-11T04:05:31.825+00:00”},“s”:“I”, “c”:“CONTROL”, “id”:23285, “ctx”:“-”,“msg”:“Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols ‘none’”}

## Expected Result:

Restore successful

## Actual Result:

Restore error

## Additional Information:

[Include any additional information that could be helpful to diagnose the issue, such as browser or device information]

---

<div class="post-metadata">

**Author:** ![dung-tien-nguyen](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/dung-tien-nguyen/32/11999_2.png) [@dung-tien-nguyen](https://forums.percona.com/u/dung-tien-nguyen)\
**Post date:** [August 15, 2023, 3:03am UTC](https://forums.percona.com/t/error-when-restore-using-operator-mongodb/24376/2 "2023-08-15T03:03:36Z")

</div>

@Sergey_Pronin this is the topic I mentioned

---

<div class="post-metadata">

**Author:** ![dung-tien-nguyen](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/dung-tien-nguyen/32/11999_2.png) [@dung-tien-nguyen](https://forums.percona.com/u/dung-tien-nguyen)\
**Post date:** [August 17, 2023, 3:27am UTC](https://forums.percona.com/t/error-when-restore-using-operator-mongodb/24376/3 "2023-08-17T03:27:25Z")

</div>

A few more updates, the above error occurs when backing up without specifying disable encrypt data. (official docs noted that [Data at rest encryption is turned on by default](https://docs.percona.com/percona-operator-for-mongodb/encryption.html#data-at-rest-encryption))

When I set “enableEncryption: false”, I was able to successfully restore to the new cluster from the backup data. This doesn’t seem to be mentioned in the backup documentation.

![image](https://us1.discourse-cdn.com/flex019/uploads/percona1/original/2X/3/3d959ef5a41cfa6cc5a02417eb187033f77fd01d.png)

I have set “pitr.enabled=false” in cluster backup and restore.  
_ **However, the new cluster launches with ghost status and I can’t get data from cluster.** _

 ![image](https://us1.discourse-cdn.com/flex019/uploads/percona1/original/2X/5/52907126e21a43fb14c3b55f627ad754b5d96ffd.png)

[ganislp](https://forums.percona.com/chat/c/ganislp/76/info),  
[Sergey\_Pronin](https://forums.percona.com/chat/c/sergey-pronin/77/info)…

---

<div class="post-metadata">

**Author:** ![Semantic](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/semantic/32/9104_2.png) [@Semantic](https://forums.percona.com/u/Semantic)\
**Post date:** [May 21, 2024, 2:24pm UTC](https://forums.percona.com/t/error-when-restore-using-operator-mongodb/24376/4 "2024-05-21T14:24:47Z")

</div>

Got the same error during replication while trying to create a multi cluster as per [this article](https://docs.percona.com/percona-operator-for-mongodb/replication.html). Interestingly, one out of the 3 nodes from that new replica appears to be progressing without issues. Is it possible the 3 of them are using the encryprion key for say `rs0-2`, rather than each taking the key that correspond to their mirror node `rs0-0`, `rs0-1` and `rs0-2`?