# POD failed to recreate after allowUnsafeConfigurations was changed from false to true

**URL:** <https://forums.percona.com/t/pod-failed-to-recreate-after-allowunsafeconfigurations-was-changed-from-false-to-true/14779>\
**Category:** Percona Operator for MongoDB\
**Created:** [March 17, 2022, 3:58am UTC](https://forums.percona.com/t/pod-failed-to-recreate-after-allowunsafeconfigurations-was-changed-from-false-to-true/14779 "2022-03-17T03:58:12Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![A\_Niu](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/a_niu/32/5518_2.png) [@A\_Niu](https://forums.percona.com/u/A_Niu)\
**Post date:** [March 17, 2022, 3:58am UTC](https://forums.percona.com/t/pod-failed-to-recreate-after-allowunsafeconfigurations-was-changed-from-false-to-true/14779/1 "2022-03-17T03:58:12Z")

</div>

Hello there,

To scale down the existing 3 pods of Mongodb cluster, I changed allowUnsafeConfigurations from false to true. As expected, all 3 pods should not be affected after apply the changes. In fact the operator terminated one pod first, and failed to recreate the pod, please shed some light on how to successfully to scale down the mongodb cluster.

Thanks,  
Arthur

```auto
NAME READY STATUS RESTARTS AGE
esi-mongodb-psmdb-operator-69c8688757-sk48x 1/1 Running 0 6d9h
mongo-soby-2-rs-0 1/1 Running 0 53m
mongo-soby-2-rs-1 1/1 Running 0 42m
mongo-soby-2-rs-2 0/1 CrashLoopBackOff 6 8m37s
mongo-soby-2-rs-2 0/1 Running 7 11m
mongo-soby-2-rs-2 0/1 Error 7 11m
mongo-soby-2-rs-2 0/1 CrashLoopBackOff 7 11m

```

Log snippet

```auto
{"level":"error","ts":1647485142.837939,"logger":"controller_psmdb","msg":"failed to update cluster status","Request.Namespace":"mongo-2","Request.Name":"mongo-soby-2","replset":"rs","error":"set upgradeInProgres: StatefulSet.apps \"mongo-soby-2-rs\" not found","errorVerbose":"StatefulSet.apps \"mongo-soby-2-rs\" not found\nset upgradeInProgres\ngithub.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodb.(*ReconcilePerconaServerMongoDB).updateStatus\n\t/go/src/github.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodb/status.go:129\ngithub.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodb.(*ReconcilePerconaServerMongoDB).Reconcile.func1\n\t/go/src/github.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodb/psmdb_controller.go:214\ngithub.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodb.(*ReconcilePerconaServerMongoDB).Reconcile\n\t/go/src/github.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodb/psmdb_controller.go:238\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/go/src/github.com/percona/percona-server-mongodb-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:256\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/percona/percona-server-mongodb-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:232\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/go/src/github.com/percona/percona-server-mongodb-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:211\nk8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/percona/percona-server-mongodb-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:152\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/percona/percona-server-mongodb-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:153\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/percona/percona-server-mongodb-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1581","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/percona/percona-server-mongodb-operator/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodb.(*ReconcilePerconaServerMongoDB).Reconcile.func1\n\t/go/src/github.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodb/psmdb_controller.go:216\ngithub.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodb.(*ReconcilePerconaServerMongoDB).Reconcile\n\t/go/src/github.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodb/psmdb_controller.go:238\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/go/src/github.com/percona/percona-server-mongodb-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:256\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/percona/percona-server-mongodb-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:232\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/go/src/github.com/percona/percona-server-mongodb-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:211\nk8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/percona/percona-server-mongodb-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:152\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/percona/percona-server-mongodb-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:153\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/percona/percona-server-mongodb-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}
{"level":"error","ts":1647485658.3497658,"logger":"controller_psmdb","msg":"issue cert with cert-manager","error":"create issuer: no matches for kind \"Issuer\" in version \"cert-manager.io/v1alpha2\"","stacktrace":"github.com/go-logr/zapr.(*zapLogger).Error\n\t/go/src/github.com/percona/percona-server-mongodb-operator/vendor/github.com/go-logr/zapr/zapr.go:128\ngithub.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodb.(*ReconcilePerconaServerMongoDB).reconsileSSL\n\t/go/src/github.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodb/ssl.go:37\ngithub.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodb.(*ReconcilePerconaServerMongoDB).Reconcile\n\t/go/src/github.com/percona/percona-server-mongodb-operator/pkg/controller/perconaservermongodb/psmdb_controller.go:299\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/go/src/github.com/percona/percona-server-mongodb-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:256\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/src/github.com/percona/percona-server-mongodb-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:232\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).worker\n\t/go/src/github.com/percona/percona-server-mongodb-operator/vendor/sigs.k8s.io/controller-runtime/pkg/internal/controller/controller.go:211\nk8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/percona/percona-server-mongodb-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:152\nk8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/percona/percona-server-mongodb-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:153\nk8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/percona/percona-server-mongodb-operator/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88"}

```

---

<div class="post-metadata">

**Author:** ![Sergey\_Pronin](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/sergey_pronin/32/14887_2.png) [@Sergey\_Pronin](https://forums.percona.com/u/Sergey_Pronin)\
**Post date:** [March 21, 2022, 9:00am UTC](https://forums.percona.com/t/pod-failed-to-recreate-after-allowunsafeconfigurations-was-changed-from-false-to-true/14779/2 "2022-03-21T09:00:07Z")

</div>

Hello @A_Niu ,

I tried to reproduce it and failed. Here is what I did:

- created the cluster with sharding disabled and 3 nodes in a replica set.

- switched `allowUnsafeConfigurations` to true. This restarted all my replica set pods one by one. My Cluster is ready.

- scaled replica set to 1 node. Still healthy and all looks okayish.

Could you please share you cr.yaml and steps to reproduce? Maybe some specifics about your setup.

---

<div class="post-metadata">

**Author:** ![A\_Niu](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/a_niu/32/5518_2.png) [@A\_Niu](https://forums.percona.com/u/A_Niu)\
**Post date:** [April 24, 2022, 5:26am UTC](https://forums.percona.com/t/pod-failed-to-recreate-after-allowunsafeconfigurations-was-changed-from-false-to-true/14779/3 "2022-04-24T05:26:33Z")

</div>

Sorry for the late response. My cluster is 3.6, this is not changeable. And your team don’t support. We have to take some workarounds.