# PBM Backup Issues on Config Server Nodes vs. Shard Nodes in Kubernetes

**URL:** <https://forums.percona.com/t/pbm-backup-issues-on-config-server-nodes-vs-shard-nodes-in-kubernetes/28555>\
**Category:** Percona Backup for MongoDB\
**Tags:** percona\
**Created:** [February 19, 2024, 1:06pm UTC](https://forums.percona.com/t/pbm-backup-issues-on-config-server-nodes-vs-shard-nodes-in-kubernetes/28555 "2024-02-19T13:06:17Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![percona921](https://avatars.discourse-cdn.com/v4/letter/p/a88e4f/32.png) [@percona921](https://forums.percona.com/u/percona921)\
**Post date:** [February 19, 2024, 1:06pm UTC](https://forums.percona.com/t/pbm-backup-issues-on-config-server-nodes-vs-shard-nodes-in-kubernetes/28555/1 "2024-02-19T13:06:17Z")

</div>

Hello,

I’m seeking assistance with an issue related to Percona Backup for MongoDB (PBM) agents in a Kubernetes environment. Specifically, backups initiated from shard-data pods appear to work fine, but backups from config server nodes fail, with PBM agents on MongoDB shard nodes reported as “NOT FOUND” or “FAILED” despite being active.

### Issue Description:

Backups initiated directly from shard-data pods execute without issue. However, when attempting backups from config server nodes, they fail, as evidenced by the following log entries from a config server node:

```auto
2024-02-16T12:30:10Z E [mongodb7-configsvr/mongodb7-configsvr-2.mongodb7-headless.mongodb.svc.cluster.local:27017] [pitr] streaming oplog: get backup start TS: run out of tries
2024-02-16T12:30:11Z I [mongodb7-configsvr/mongodb7-configsvr-2.mongodb7-headless.mongodb.svc.cluster.local:27017] [backup/2024-02-16T12:29:19Z] mark backup as error `couldn't get response from all shards: convergeClusterWithTimeout: reached converge timeout`: <nil>
2024-02-16T12:30:11Z E [mongodb7-configsvr/mongodb7-configsvr-2.mongodb7-headless.mongodb.svc.cluster.local:27017] [backup/2024-02-16T12:29:19Z] backup: couldn't get response from all shards: convergeClusterWithTimeout: reached converge timeout

```

I appreciate any advice, insights, or guidance the community can offer to help resolve these backup inconsistencies within our sharded MongoDB cluster

---

<div class="post-metadata">

**Author:** ![Dmytro\_Zghoba](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/dmytro_zghoba/32/4721_2.png) [@Dmytro\_Zghoba](https://forums.percona.com/u/Dmytro_Zghoba)\
**Post date:** [March 1, 2024, 8:38am UTC](https://forums.percona.com/t/pbm-backup-issues-on-config-server-nodes-vs-shard-nodes-in-kubernetes/28555/2 "2024-03-01T08:38:54Z")

</div>

hi,

This is not enough to understand. Can you send full pbm logs for the backup?