Can't start backup. Previous backup is still in progress

PostgreSQL Percona Operator for PostgreSQL
1

Description:

Backup jobs not created anymore

Steps to Reproduce:

Version:

2.6.0

Logs:

2025-05-12T12:53:44.628Z INFO Can’t start backup. Previous backup is still in progress {“controller”: “perconapgbackup”, “controllerGroup”: “pgv2.percona.com”, “controllerKind”: “PerconaPGBackup”, “PerconaPGBackup”: {“name”:“billing-db-repo2-full-5nzpm”,“namespace”:“billing-qa”}, “namespace”: “billing-qa”, “name”: “billing-db-repo2-full-5nzpm”, “reconcileID”: “381026ad-8d91-4113-8a62-7175363f54c8”, “request”: {“name”:“billing-db-repo2-full-5nzpm”,“namespace”:“billing-qa”}, “pg-backup”: “billing-db-repo2-full-5nzpm”, “cluster”: “billing-db”}

2025-05-12T12:53:46.242Z INFO Can’t start backup. Previous backup is still in progress {“controller”: “perconapgbackup”, “controllerGroup”: “pgv2.percona.com”, “controllerKind”: “PerconaPGBackup”, “PerconaPGBackup”: {“name”:“backup-64x”,“namespace”:“billing-qa”}, “namespace”: “billing-qa”, “name”: “backup-64x”, “reconcileID”: “f96aa7ad-5068-4b44-9b13-e783dde93600”, “request”: {“name”:“backup-64x”,“namespace”:“billing-qa”}, “pg-backup”: “backup-64x”, “cluster”: “billing-db”}

apiVersion: pgv2.percona.com/v2
kind: PerconaPGBackup
metadata:
creationTimestamp: ‘2025-05-11T21:00:06Z’
finalizers:
- internal.percona.com/delete-backup
generateName: billing-db-repo2-full-
generation: 1
name: billing-db-repo2-full-5nzpm
namespace: billing-qa
ownerReferences:
- apiVersion: everest.percona.com/v1alpha1
blockOwnerDeletion: true
kind: DatabaseClusterBackup
name: billing-db-repo2-full-5nzpm
uid: eaec6a67-9b63-4d18-a64f-4d77ed57bba7
resourceVersion: ‘104619526’
uid: 7e27dc07-7fb3-4efd-b131-29292a0bacc0
selfLink: >-
/apis/pgv2.percona.com/v2/namespaces/billing-qa/perconapgbackups/billing-db-repo2-full-5nzpm
spec:
options:
- ‘–type=full’
pgCluster: billing-db
repoName: repo2

apiVersion: everest.percona.com/v1alpha1
kind: DatabaseClusterBackup
metadata:
creationTimestamp: ‘2025-05-11T21:00:06Z’
finalizers:
- foregroundDeletion
generation: 1
labels:
backupStorage-backup: used
clusterName: billing-db
managedFields:
- apiVersion: everest.percona.com/v1alpha1
fieldsType: FieldsV1
fieldsV1:
f:metadata:
f:finalizers:
.: {}
v:“foregroundDeletion”: {}
f:labels:
.: {}
f:backupStorage-backup: {}
f:clusterName: {}
f:ownerReferences:
.: {}
k:{“uid”:“ea1cae23-f624-4bec-8d67-f7f0eea703c0”}: {}
f:spec:
.: {}
f:backupStorageName: {}
f:dbClusterName: {}
manager: manager
operation: Update
time: ‘2025-05-11T21:00:06Z’
- apiVersion: everest.percona.com/v1alpha1
fieldsType: FieldsV1
fieldsV1:
f:status:
.: {}
f:created: {}
f:gaps: {}
manager: manager
operation: Update
subresource: status
time: ‘2025-05-11T21:00:06Z’
name: billing-db-repo2-full-5nzpm
namespace: billing-qa
ownerReferences:
- apiVersion: everest.percona.com/v1alpha1
blockOwnerDeletion: true
controller: true
kind: DatabaseCluster
name: billing-db
uid: ea1cae23-f624-4bec-8d67-f7f0eea703c0
resourceVersion: ‘104619527’
uid: eaec6a67-9b63-4d18-a64f-4d77ed57bba7
spec:
backupStorageName: backup
dbClusterName: billing-db
status:
created: ‘2025-05-11T21:00:06Z’
gaps: false

2

I can RUN backup manually:

pgbackrest --repo=repo2 backup --stanza=db --type=full --log-level-console=info

bash-5.1$ pgbackrest info
stanza: db
status: ok
cipher: none

db (current)
    wal archive min/max (16): 00000026000000080000006C/000000260000000800000072

    full backup: 20250512-161930F
        timestamp start/stop: 2025-05-12 16:19:30+03 / 2025-05-12 16:19:42+03
        wal start/stop: 00000026000000080000006C / 00000026000000080000006D
        database size: 70.4MB, database backup size: 70.4MB
        repo1: backup set size: 10.8MB, backup size: 10.8MB

    full backup: 20250512-162004F
        timestamp start/stop: 2025-05-12 16:20:51+03 / 2025-05-12 16:22:17+03
        wal start/stop: 000000260000000800000070 / 000000260000000800000071
        database size: 70.5MB, database backup size: 70.5MB
        repo2: backup set size: 10.8MB, backup size: 10.8MB
3

Hi @pstekunov could you please send your CR as well?

4

And could you please provide full operator log.

5

I came across this thread, and it appears like the same issue I’m facing.

Operator version: 2.3.1

  • The PerconaPGBackup hangs in State: Starting indefinately.
  • No Jobs / Pods show up.
  • If I delete the job and wipe the “backup” annotations from the PerconaPGCluster CR, the same thing happens.
  • Manual backups via the repo pod work fine.

PerconaPGBackup CR:

apiVersion: pgv2.percona.com/v2
kind: PerconaPGBackup
metadata:
  creationTimestamp: "2025-05-26T00:00:01Z"
  generateName: pg-repo1-diff-
  generation: 1
  name: pg-repo1-diff-8tntb
  namespace: data
  resourceVersion: "530916486"
  uid: f757f287-c126-4e50-8db2-8ec89973aea7
spec:
  options:
  - --type=diff
  pgCluster: pg
  repoName: repo1
status:
  image: percona/percona-postgresql-operator:2.3.1-ppg16-pgbackrest
  repo:
    name: repo1
    schedules:
      differential: 0 0 * * 0-5
      full: 0 0 * * 6
    volume:
      volumeClaimSpec:
        accessModes:
        - ReadWriteOnce
        resources:
          requests:
            storage: 64Gi
  state: Starting
  storageType: filesystem

PerconaPGCluster CR

apiVersion: pgv2.percona.com/v2
kind: PerconaPGCluster
metadata:
  annotations:
    objectset.rio.cattle.io/id: default-deployment-data-postgres
    pgv2.percona.com/backup-in-progress: pg-repo1-full-vgvfm
    postgres-operator.crunchydata.com/pgbackrest-backup: pg-repo1-full-vgvfm
  labels:
    objectset.rio.cattle.io/hash: c53c0310aea7f1d0e45d47a72988a4f95a895f50
  name: pg
  namespace: data
spec:
  backups:
    pgbackrest:
      global:
        repo1-retention-full: "8"
        repo1-retention-full-type: count
      image: percona/percona-postgresql-operator:2.3.1-ppg16-pgbackrest
      manual:
        options:
        - --type=full
        repoName: repo1
      repoHost:
        affinity:
          podAntiAffinity:
            preferredDuringSchedulingIgnoredDuringExecution:
            - podAffinityTerm:
                labelSelector:
                  matchLabels:
                    postgres-operator.crunchydata.com/data: pgbackrest
                topologyKey: kubernetes.io/hostname
              weight: 1
      repos:
      - name: repo1
        schedules:
          differential: 0 0 * * 0-5
          full: 0 0 * * 6
        volume:
          volumeClaimSpec:
            accessModes:
            - ReadWriteOnce
            resources:
              requests:
                storage: 200Gi
  crVersion: 2.3.1
  image: percona/percona-postgresql-operator:2.3.1-ppg16-postgres
  imagePullPolicy: Always
  instances:
  - affinity:
      podAntiAffinity:
        preferredDuringSchedulingIgnoredDuringExecution:
        - podAffinityTerm:
            labelSelector:
              matchLabels:
                postgres-operator.crunchydata.com/data: postgres
            topologyKey: kubernetes.io/hostname
          weight: 1
    dataVolumeClaimSpec:
      accessModes:
      - ReadWriteOnce
      resources:
        requests:
          storage: 64Gi
    name: instance1
    replicas: 3
  patroni:
    dynamicConfiguration:
      postgresql:
        parameters:
          max_connections: 300
    leaderLeaseDurationSeconds: 30
    port: 8008
    syncPeriodSeconds: 10
  pmm:
    enabled: false
    image: percona/pmm-client:2.41.0
    secret: cluster1-pmm-secret
    serverHost: monitoring-service
  port: 5432
  postgresVersion: 16
  proxy:
    pgBouncer:
      affinity:
        podAntiAffinity:
          preferredDuringSchedulingIgnoredDuringExecution:
          - podAffinityTerm:
              labelSelector:
                matchLabels:
                  postgres-operator.crunchydata.com/role: pgbouncer
              topologyKey: kubernetes.io/hostname
            weight: 1
      config:
        global:
          default_pool_size: "50"
          max_client_conn: "200"
      exposeSuperusers: true
      image: percona/percona-postgresql-operator:2.3.1-ppg16-pgbouncer
      port: 5432
      replicas: 3

Operator logs:

percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.731Z	INFO	feature gates enabled	{"PGO_FEATURE_GATES": "TablespaceVolumes=false,BridgeIdentifiers=false,InstanceSidecars=true,AllAlpha=false,AllBeta=false,PGBouncerSidecars=false"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	starting controller runtime manager and will wait for signal to exit
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	controller-runtime.metrics	Starting metrics server
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	controller-runtime.metrics	Serving metrics server	{"bindAddress": ":8080", "secure": false}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting EventSource	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "source": "kind source: *v2.PerconaPGCluster"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1beta1.PostgresCluster"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting EventSource	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "source": "kind source: *v1beta1.PostgresCluster"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.ConfigMap"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting EventSource	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "source": "kind source: *v1.Service"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting EventSource	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "source": "kind source: *v2.PerconaPGBackup"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting EventSource	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "source": "kind source: *v1.Secret"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting Controller	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.Endpoints"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting EventSource	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "source": "kind source: *v1.Job"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.PersistentVolumeClaim"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.Secret"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting EventSource	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "source": "kind source: *v2.PerconaPGBackup"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.Service"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting Controller	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.ServiceAccount"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.Deployment"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.StatefulSet"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.Job"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.Role"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.RoleBinding"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.CronJob"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.758Z	INFO	Starting EventSource	{"controller": "perconapgrestore", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGRestore", "source": "kind source: *v2.PerconaPGRestore"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.759Z	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.PodDisruptionBudget"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.759Z	INFO	Starting Controller	{"controller": "perconapgrestore", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGRestore"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.759Z	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.Pod"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.759Z	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.StatefulSet"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.759Z	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.Secret"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.759Z	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.Job"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.759Z	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v2.PerconaPGBackup"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:33.759Z	INFO	Starting Controller	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster"}
percona-postgresql-operator-bc4ff464b-njq95 operator I0528 15:35:34.809249       1 request.go:697] Waited for 1.045724421s due to client-side throttling, not priority and fairness, request: GET:https://10.43.0.1:443/apis
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:35.661Z	INFO	Starting workers	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "worker count": 1}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:35.911Z	INFO	Can't start backup. Previous backup is still in progress	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "PerconaPGBackup": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "namespace": "data", "name": "pg-repo1-full-vgvfm", "reconcileID": "ab3aa7a8-350b-4e11-aae6-64c34d9b0cd6", "request": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "pg-backup": "pg-repo1-full-vgvfm", "cluster": "pg"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:36.162Z	INFO	Starting workers	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "worker count": 1}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:36.363Z	INFO	Starting workers	{"controller": "perconapgrestore", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGRestore", "worker count": 1}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:36.413Z	INFO	Starting workers	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "worker count": 2}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:40.912Z	INFO	Can't start backup. Previous backup is still in progress	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "PerconaPGBackup": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "namespace": "data", "name": "pg-repo1-full-vgvfm", "reconcileID": "742b2d54-418d-457a-a0f3-4071dffb9caf", "request": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "pg-backup": "pg-repo1-full-vgvfm", "cluster": "pg"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:45.913Z	INFO	Can't start backup. Previous backup is still in progress	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "PerconaPGBackup": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "namespace": "data", "name": "pg-repo1-full-vgvfm", "reconcileID": "9f56606c-982f-43fa-8c09-fd518e17cfe2", "request": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "pg-backup": "pg-repo1-full-vgvfm", "cluster": "pg"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:50.914Z	INFO	Can't start backup. Previous backup is still in progress	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "PerconaPGBackup": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "namespace": "data", "name": "pg-repo1-full-vgvfm", "reconcileID": "fca76e54-02e6-4bd3-a5e4-d680ed989553", "request": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "pg-backup": "pg-repo1-full-vgvfm", "cluster": "pg"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:35:55.915Z	INFO	Can't start backup. Previous backup is still in progress	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "PerconaPGBackup": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "namespace": "data", "name": "pg-repo1-full-vgvfm", "reconcileID": "b2d773f6-b785-4a80-a2bd-806d53d90b59", "request": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "pg-backup": "pg-repo1-full-vgvfm", "cluster": "pg"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:36:00.916Z	INFO	Can't start backup. Previous backup is still in progress	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "PerconaPGBackup": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "namespace": "data", "name": "pg-repo1-full-vgvfm", "reconcileID": "2a8c1d30-2c94-4143-b313-3b84a4797648", "request": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "pg-backup": "pg-repo1-full-vgvfm", "cluster": "pg"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:36:05.917Z	INFO	Can't start backup. Previous backup is still in progress	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "PerconaPGBackup": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "namespace": "data", "name": "pg-repo1-full-vgvfm", "reconcileID": "f694f2ed-9cd9-4d3b-9339-0f89547e6ded", "request": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "pg-backup": "pg-repo1-full-vgvfm", "cluster": "pg"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:36:10.919Z	INFO	Can't start backup. Previous backup is still in progress	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "PerconaPGBackup": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "namespace": "data", "name": "pg-repo1-full-vgvfm", "reconcileID": "4ffecb82-bd00-49f1-8859-2a614137c018", "request": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "pg-backup": "pg-repo1-full-vgvfm", "cluster": "pg"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:36:15.920Z	INFO	Can't start backup. Previous backup is still in progress	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "PerconaPGBackup": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "namespace": "data", "name": "pg-repo1-full-vgvfm", "reconcileID": "975246b1-a628-47f5-9391-02d9795fc515", "request": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "pg-backup": "pg-repo1-full-vgvfm", "cluster": "pg"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:36:20.921Z	INFO	Can't start backup. Previous backup is still in progress	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "PerconaPGBackup": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "namespace": "data", "name": "pg-repo1-full-vgvfm", "reconcileID": "7d490786-5872-4788-8b9a-bd711a5efe46", "request": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "pg-backup": "pg-repo1-full-vgvfm", "cluster": "pg"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:36:25.922Z	INFO	Can't start backup. Previous backup is still in progress	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "PerconaPGBackup": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "namespace": "data", "name": "pg-repo1-full-vgvfm", "reconcileID": "165536b9-ccd2-4801-a7e9-cff784b7dfcd", "request": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "pg-backup": "pg-repo1-full-vgvfm", "cluster": "pg"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:36:30.954Z	INFO	Backup is starting	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "PerconaPGBackup": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "namespace": "data", "name": "pg-repo1-full-vgvfm", "reconcileID": "103c08fa-9d2a-4cd4-8c8f-efaa073a0e7f", "request": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "backup": "pg-repo1-full-vgvfm", "cluster": "pg"}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:36:30.955Z	INFO	Waiting for backup to start	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "PerconaPGBackup": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "namespace": "data", "name": "pg-repo1-full-vgvfm", "reconcileID": "77e7bb8c-53cf-441d-a724-0d01c18a1c7d", "request": {"name":"pg-repo1-full-vgvfm","namespace":"data"}}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:36:35.956Z	INFO	Waiting for backup to start	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "PerconaPGBackup": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "namespace": "data", "name": "pg-repo1-full-vgvfm", "reconcileID": "cb3a483c-8bed-4ff1-b36d-aee51614f39f", "request": {"name":"pg-repo1-full-vgvfm","namespace":"data"}}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:36:40.957Z	INFO	Waiting for backup to start	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "PerconaPGBackup": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "namespace": "data", "name": "pg-repo1-full-vgvfm", "reconcileID": "c2d536f6-a535-455a-b686-309e6065855e", "request": {"name":"pg-repo1-full-vgvfm","namespace":"data"}}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:36:45.958Z	INFO	Waiting for backup to start	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "PerconaPGBackup": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "namespace": "data", "name": "pg-repo1-full-vgvfm", "reconcileID": "bf60e71c-e1a8-4825-a207-b89b8673b9ad", "request": {"name":"pg-repo1-full-vgvfm","namespace":"data"}}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:36:50.959Z	INFO	Waiting for backup to start	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "PerconaPGBackup": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "namespace": "data", "name": "pg-repo1-full-vgvfm", "reconcileID": "d0c59543-122d-41d4-93a1-33004f74c992", "request": {"name":"pg-repo1-full-vgvfm","namespace":"data"}}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:36:55.960Z	INFO	Waiting for backup to start	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "PerconaPGBackup": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "namespace": "data", "name": "pg-repo1-full-vgvfm", "reconcileID": "b3bdeff0-74f3-4496-bb6b-f50a8f190bed", "request": {"name":"pg-repo1-full-vgvfm","namespace":"data"}}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:37:00.961Z	INFO	Waiting for backup to start	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "PerconaPGBackup": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "namespace": "data", "name": "pg-repo1-full-vgvfm", "reconcileID": "a6fc5a4d-6d00-425e-add1-610ecc39a01a", "request": {"name":"pg-repo1-full-vgvfm","namespace":"data"}}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:37:05.963Z	INFO	Waiting for backup to start	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "PerconaPGBackup": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "namespace": "data", "name": "pg-repo1-full-vgvfm", "reconcileID": "45852078-ca3a-42ee-b280-d8eaba01169e", "request": {"name":"pg-repo1-full-vgvfm","namespace":"data"}}
percona-postgresql-operator-bc4ff464b-njq95 operator 2025-05-28T15:37:10.964Z	INFO	Waiting for backup to start	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "PerconaPGBackup": {"name":"pg-repo1-full-vgvfm","namespace":"data"}, "namespace": "data", "name": "pg-repo1-full-vgvfm", "reconcileID": "fb11cc09-6a23-465c-832e-2b13eb3e133b", "request": {"name":"pg-repo1-full-vgvfm","namespace":"data"}}
6

@pstekunov @gissur i faced the same issue recently in operator version 2.6.0. Some backup got stuck in running and then after deleting it the operator was still stuck in the error “Can’t start backup. Previous backup is still in progress” so after spending a lot of time i finally found the fix .. you have the delete the stuck backup and in cr there must be an annotation

annotations:
pgv2.percona.com/backup-in-progress: pgcl01-sa-aks-repo4-full-sbh79
postgres-operator.crunchydata.com/pgbackrest-backup: pgcl01-sa-aks-repo4-full-sbh79

this needs to be removed as well then it will be fixed .

i don’t know what is the root cause but this is the fix anyways .

1 Like