I’m having some real trouble restoring a backup from a database that seems to have died. I’m not 100% sure what went wrong with the MongoDB - I unfortunately don’t have the logs, but suspect it was something to do with the SSL config.
Also unfortunately, I don’t have the credentials for the management users (e.g. userAdmin, clusterAdmin, etc) that exist on the backup… and the existing database has been deleted.
All I really need to do is extract the data from the backup - I can manually load it into a new MongoDB instance if need be. However, whenever I run the restore job, it seems to work fine but then the replicaset pods all start dying and I can’t connect to grab the data. I have been able to connect by directly remoting into the mongos pod, but that only lasts for a few minutes before the other pods start dying.
The cr.yaml that I’m using is exactly the same as the one used on the old database. Same number of shards, same number of replicas, etc.
I thought it might be that the restore job is overwriting the creds of the cluster management users, so I tried creating them with different names by manually creating a secret with the users + passwords, but no luck there either.
I’m kind of out of ideas at this point - is there anything else I could try?
Any help would be much appreciated!
EDIT: Forgot to mention - I do have the username and password for a root user in the backup, just not the clusterAdmin etc users.
EDIT 2: I’ve managed to log in to the restored cluster and update the passwords for the management users to match the ones I manually set. This initially seemed to fix the issue, I was able to connect, but the replica sets now error and restart around once every 2-3 minutes. I’m not really sure how to go about debugging this!