Pg-instances from percona pg-db chart is not going to be setup

Ahmad_Abdolmaleki · October 2, 2024, 12:45pm

Description:

At first I should mention that I’m Ok with version 2.3.X of the pg-operator and pg-db.

now I want to setup a new cluster with the version 2.4.1 of the helm charts for pg operator and 2.4.3 for pg db.

The operator setup goes straightforward. Then when I want to setup the pg-db with 1 instance for postgres and 1 for pgbouncer, the pgbouncer comes up but there is nothing for postgres and the operator raises the following error.

Steps to Reproduce:

my values.yaml is something like:

finalizers:
crVersion: 2.4.1
repository: percona/percona-postgresql-operator
image: percona/percona-postgresql-operator:2.4.1-ppg16.3-postgres
imagePullPolicy: Always
postgresVersion: 16
pause: false
unmanaged: false
standby:
  enabled: false
customTLSSecret:
  name: ""
customReplicationTLSSecret:
  name: ""
users:
  - name: postgres
    password:
      type: AlphaNumeric
instances:
- name: instance1
  replicas: 1
  affinity:
    podAntiAffinity:
      preferredDuringSchedulingIgnoredDuringExecution:
      - weight: 1
        podAffinityTerm:
          labelSelector:
            matchLabels:
              postgres-operator.crunchydata.com/data: postgres
          topologyKey: kubernetes.io/hostname
  resources:
    requests:
      cpu: 1
      memory: 2Gi
    limits:
      cpu: 500m
      memory: 1Gi
  dataVolumeClaimSpec:
    storageClassName: 'nfs-read-write-once'
    accessModes:
    - ReadWriteOnce
    resources:
      requests:
        storage: 5Gi
proxy:
  pgBouncer:
    replicas: 1
    image: percona/percona-postgresql-operator:2.4.1-ppg16.3-pgbouncer1.22.1
    exposeSuperusers: true
    resources:
      limits:
        cpu: 200m
        memory: 128Mi
    expose:
      type: NodePort
    affinity:
      podAntiAffinity:
        preferredDuringSchedulingIgnoredDuringExecution:
        - weight: 1
          podAffinityTerm:
            labelSelector:
              matchLabels:
                postgres-operator.crunchydata.com/role: pgbouncer
            topologyKey: kubernetes.io/hostname
    config:
      global:
        pool_mode: session
backups:
  pgbackrest:
    image: percona/percona-postgresql-operator:2.4.1-ppg16.3-pgbackrest2.51-1
    repoHost:
      affinity:
        podAntiAffinity:
          preferredDuringSchedulingIgnoredDuringExecution:
          - weight: 1
            podAffinityTerm:
              labelSelector:
                matchLabels:
                  postgres-operator.crunchydata.com/data: pgbackrest
              topologyKey: kubernetes.io/hostname
    manual:
      repoName: repo1
      options:
      - --type=full
    repos:
    - name: repo1
      schedules:
        full: "0 0 1 9 *"
        # full: "0 0 * * 6"
      volume:
        volumeClaimSpec:
          storageClassName: "nfs-read-write-once"
          accessModes:
          - ReadWriteOnce
          resources:
            requests:
              storage: 1Gi
pmm:
  enabled: false
  image:
    repository: percona/pmm-client
    tag: 2.42.0
  secret: cluster1-pmm-secret
  serverHost: monitoring-service
secrets:
  name:
  # replication user password
  primaryuser: ...

Version:

2.4.3

Logs:

2024-10-02T14:13:07.809+0330	INFO	feature gates enabled	{"PGO_FEATURE_GATES": "AppendCustomQueries=false,BridgeIdentifiers=false,CrunchyBridgeClusters=false,AllBeta=false,AllAlpha=false,InstanceSidecars=true,PGBouncerSidecars=false,TablespaceVolumes=true"}
2024-10-02T14:13:08.404+0330	INFO	starting controller runtime manager and will wait for signal to exit
2024-10-02T14:13:08.404+0330	INFO	controller-runtime.metrics	Starting metrics server
2024-10-02T14:13:08.405+0330	INFO	controller-runtime.metrics	Serving metrics server	{"bindAddress": ":8080", "secure": false}
2024-10-02T14:13:08.506+0330	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1beta1.PostgresCluster"}
2024-10-02T14:13:08.506+0330	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.ConfigMap"}
2024-10-02T14:13:08.506+0330	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.Endpoints"}
2024-10-02T14:13:08.506+0330	INFO	Starting EventSource	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "source": "kind source: *v2.PerconaPGBackup"}
2024-10-02T14:13:08.506+0330	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.PersistentVolumeClaim"}
2024-10-02T14:13:08.506+0330	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.Secret"}
2024-10-02T14:13:08.506+0330	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.Service"}
2024-10-02T14:13:08.506+0330	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.ServiceAccount"}
2024-10-02T14:13:08.506+0330	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.Deployment"}
2024-10-02T14:13:08.506+0330	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.StatefulSet"}
2024-10-02T14:13:08.506+0330	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.Job"}
2024-10-02T14:13:08.506+0330	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.Role"}
2024-10-02T14:13:08.506+0330	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.RoleBinding"}
2024-10-02T14:13:08.506+0330	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.CronJob"}
2024-10-02T14:13:08.506+0330	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.PodDisruptionBudget"}
2024-10-02T14:13:08.506+0330	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.Pod"}
2024-10-02T14:13:08.509+0330	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.StatefulSet"}
2024-10-02T14:13:08.509+0330	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.Secret"}
2024-10-02T14:13:08.509+0330	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v1.Job"}
2024-10-02T14:13:08.509+0330	INFO	Starting EventSource	{"controller": "perconapgrestore", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGRestore", "source": "kind source: *v2.PerconaPGRestore"}
2024-10-02T14:13:08.509+0330	INFO	Starting EventSource	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "source": "kind source: *v2.PerconaPGBackup"}
2024-10-02T14:13:08.509+0330	INFO	Starting Controller	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster"}
2024-10-02T14:13:08.509+0330	INFO	Starting EventSource	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "source": "kind source: *v2.PerconaPGCluster"}
2024-10-02T14:13:08.509+0330	INFO	Starting EventSource	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "source": "channel source: 0xc0007a5030"}
2024-10-02T14:13:08.509+0330	INFO	Starting EventSource	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "source": "kind source: *v1beta1.PostgresCluster"}
2024-10-02T14:13:08.509+0330	INFO	Starting Controller	{"controller": "perconapgrestore", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGRestore"}
2024-10-02T14:13:08.509+0330	INFO	Starting Controller	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup"}
2024-10-02T14:13:08.509+0330	INFO	Starting EventSource	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "source": "kind source: *v1.Service"}
2024-10-02T14:13:08.509+0330	INFO	Starting EventSource	{"controller": "pgupgrade", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PGUpgrade", "source": "kind source: *v1beta1.PGUpgrade"}
2024-10-02T14:13:08.509+0330	INFO	Starting EventSource	{"controller": "pgupgrade", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PGUpgrade", "source": "kind source: *v1.Job"}
2024-10-02T14:13:08.509+0330	INFO	Starting EventSource	{"controller": "pgupgrade", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PGUpgrade", "source": "kind source: *v1beta1.PostgresCluster"}
2024-10-02T14:13:08.509+0330	INFO	Starting EventSource	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "source": "kind source: *v1.Secret"}
2024-10-02T14:13:08.509+0330	INFO	Starting EventSource	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "source": "kind source: *v1.Job"}
2024-10-02T14:13:08.509+0330	INFO	Starting Controller	{"controller": "pgupgrade", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PGUpgrade"}
2024-10-02T14:13:08.509+0330	INFO	Starting EventSource	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "source": "kind source: *v2.PerconaPGBackup"}
2024-10-02T14:13:08.509+0330	INFO	Starting Controller	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster"}
2024-10-02T14:13:08.509+0330	INFO	Starting EventSource	{"controller": "pgadmin", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PGAdmin", "source": "kind source: *v1beta1.PGAdmin"}
2024-10-02T14:13:08.509+0330	INFO	Starting EventSource	{"controller": "pgadmin", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PGAdmin", "source": "kind source: *v1.ConfigMap"}
2024-10-02T14:13:08.509+0330	INFO	Starting EventSource	{"controller": "pgadmin", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PGAdmin", "source": "kind source: *v1.PersistentVolumeClaim"}
2024-10-02T14:13:08.509+0330	INFO	Starting EventSource	{"controller": "perconapgupgrade", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGUpgrade", "source": "kind source: *v2.PerconaPGUpgrade"}
2024-10-02T14:13:08.509+0330	INFO	Starting Controller	{"controller": "perconapgupgrade", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGUpgrade"}
2024-10-02T14:13:08.509+0330	INFO	Starting EventSource	{"controller": "pgadmin", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PGAdmin", "source": "kind source: *v1.Secret"}
2024-10-02T14:13:08.509+0330	INFO	Starting EventSource	{"controller": "pgadmin", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PGAdmin", "source": "kind source: *v1.StatefulSet"}
2024-10-02T14:13:08.509+0330	INFO	Starting EventSource	{"controller": "pgadmin", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PGAdmin", "source": "kind source: *v1beta1.PostgresCluster"}
2024-10-02T14:13:08.509+0330	INFO	Starting Controller	{"controller": "pgadmin", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PGAdmin"}
2024-10-02T14:13:08.611+0330	INFO	Starting workers	{"controller": "perconapgbackup", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGBackup", "worker count": 1}
2024-10-02T14:13:09.203+0330	INFO	Starting workers	{"controller": "perconapgupgrade", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGUpgrade", "worker count": 1}
2024-10-02T14:13:09.205+0330	INFO	Starting workers	{"controller": "pgadmin", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PGAdmin", "worker count": 1}
2024-10-02T14:13:09.205+0330	INFO	Starting workers	{"controller": "postgrescluster", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PostgresCluster", "worker count": 2}
2024-10-02T14:13:09.205+0330	INFO	Starting workers	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "worker count": 1}
2024-10-02T14:13:09.205+0330	INFO	Starting workers	{"controller": "perconapgrestore", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGRestore", "worker count": 1}
2024-10-02T14:13:09.217+0330	INFO	Starting workers	{"controller": "pgupgrade", "controllerGroup": "postgres-operator.crunchydata.com", "controllerKind": "PGUpgrade", "worker count": 1}
2024-10-02T14:39:00.726+0330	INFO	Starting WAL watcher	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "PerconaPGCluster": {"name":"pg-db","namespace":"postgres-ai"}, "namespace": "postgres-ai", "name": "pg-db", "reconcileID": "f987342e-1135-4c68-9270-6c4873e73edc", "name": "postgres-ai-pg-db-wal-watcher"}
2024-10-02T14:39:00.726+0330	INFO	Watching commit timestamps	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "PerconaPGCluster": {"name":"pg-db","namespace":"postgres-ai"}, "namespace": "postgres-ai", "name": "pg-db", "reconcileID": "f987342e-1135-4c68-9270-6c4873e73edc"}
2024-10-02T14:39:10.736+0330	ERROR	get latest backup	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "PerconaPGCluster": {"name":"pg-db","namespace":"postgres-ai"}, "namespace": "postgres-ai", "name": "pg-db", "reconcileID": "f987342e-1135-4c68-9270-6c4873e73edc", "error": "no completed backups found", "errorVerbose": "no completed backups found\ngithub.com/percona/percona-postgresql-operator/percona/watcher.getLatestBackup\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/watcher/wal.go:129\ngithub.com/percona/percona-postgresql-operator/percona/watcher.WatchCommitTimestamps\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/watcher/wal.go:65\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1695"}
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1695
2024-10-02T14:39:10.828+0330	ERROR	ensure version	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "PerconaPGCluster": {"name":"pg-db","namespace":"postgres-ai"}, "namespace": "postgres-ai", "name": "pg-db", "reconcileID": "f987342e-1135-4c68-9270-6c4873e73edc", "error": "failed to send telemetry to https://check.percona.com: version service apply: Get \"https://check.percona.com/versions/v1/pg-operator/2.4.1/disabled?customResourceUid=e520622e-792c-45e3-8c7f-c420ca7df09b&databaseVersion=16&helmDeployCr=true&helmDeployOperator=true&kubeVersion=v1.29.5&platform=unknown&pmmEnabled=false&sidecarsUsed=false\": context deadline exceeded", "errorVerbose": "Get \"https://check.percona.com/versions/v1/pg-operator/2.4.1/disabled?customResourceUid=e520622e-792c-45e3-8c7f-c420ca7df09b&databaseVersion=16&helmDeployCr=true&helmDeployOperator=true&kubeVersion=v1.29.5&platform=unknown&pmmEnabled=false&sidecarsUsed=false\": context deadline exceeded\nversion service apply\ngithub.com/percona/percona-postgresql-operator/percona/version.fetchVersions\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/version/version.go:77\ngithub.com/percona/percona-postgresql-operator/percona/version.EnsureVersion\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/version/version.go:34\ngithub.com/percona/percona-postgresql-operator/percona/controller/pgcluster.(*PGClusterReconciler).reconcileVersion\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/controller/pgcluster/version.go:33\ngithub.com/percona/percona-postgresql-operator/percona/controller/pgcluster.(*PGClusterReconciler).Reconcile\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/controller/pgcluster/controller.go:222\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:114\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:311\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:261\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:222\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1695\nfailed to send telemetry to https://check.percona.com\ngithub.com/percona/percona-postgresql-operator/percona/version.EnsureVersion\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/version/version.go:36\ngithub.com/percona/percona-postgresql-operator/percona/controller/pgcluster.(*PGClusterReconciler).reconcileVersion\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/controller/pgcluster/version.go:33\ngithub.com/percona/percona-postgresql-operator/percona/controller/pgcluster.(*PGClusterReconciler).Reconcile\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/controller/pgcluster/controller.go:222\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:114\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:311\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:261\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:222\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1695"}
github.com/percona/percona-postgresql-operator/percona/controller/pgcluster.(*PGClusterReconciler).Reconcile
	/go/src/github.com/percona/percona-postgresql-operator/percona/controller/pgcluster/controller.go:222
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:114
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:311
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:261
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:222
2024-10-02T14:39:20.736+0330	ERROR	get latest backup	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "PerconaPGCluster": {"name":"pg-db","namespace":"postgres-ai"}, "namespace": "postgres-ai", "name": "pg-db", "reconcileID": "f987342e-1135-4c68-9270-6c4873e73edc", "error": "no completed backups found", "errorVerbose": "no completed backups found\ngithub.com/percona/percona-postgresql-operator/percona/watcher.getLatestBackup\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/watcher/wal.go:129\ngithub.com/percona/percona-postgresql-operator/percona/watcher.WatchCommitTimestamps\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/watcher/wal.go:65\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1695"}
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1695
2024-10-02T14:39:30.735+0330	ERROR	get latest backup	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "PerconaPGCluster": {"name":"pg-db","namespace":"postgres-ai"}, "namespace": "postgres-ai", "name": "pg-db", "reconcileID": "f987342e-1135-4c68-9270-6c4873e73edc", "error": "no completed backups found", "errorVerbose": "no completed backups found\ngithub.com/percona/percona-postgresql-operator/percona/watcher.getLatestBackup\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/watcher/wal.go:129\ngithub.com/percona/percona-postgresql-operator/percona/watcher.WatchCommitTimestamps\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/watcher/wal.go:65\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1695"}
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1695
2024-10-02T14:39:40.736+0330	ERROR	get latest backup	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "PerconaPGCluster": {"name":"pg-db","namespace":"postgres-ai"}, "namespace": "postgres-ai", "name": "pg-db", "reconcileID": "f987342e-1135-4c68-9270-6c4873e73edc", "error": "no completed backups found", "errorVerbose": "no completed backups found\ngithub.com/percona/percona-postgresql-operator/percona/watcher.getLatestBackup\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/watcher/wal.go:129\ngithub.com/percona/percona-postgresql-operator/percona/watcher.WatchCommitTimestamps\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/watcher/wal.go:65\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1695"}
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1695
2024-10-02T14:39:45.988+0330	ERROR	ensure version	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "PerconaPGCluster": {"name":"pg-db","namespace":"postgres-ai"}, "namespace": "postgres-ai", "name": "pg-db", "reconcileID": "b66ed494-f7fb-449c-92ed-dd61331f47aa", "error": "failed to send telemetry to https://check.percona.com: version service apply: Get \"https://check.percona.com/versions/v1/pg-operator/2.4.1/disabled?customResourceUid=e520622e-792c-45e3-8c7f-c420ca7df09b&databaseVersion=16&helmDeployCr=true&helmDeployOperator=true&kubeVersion=v1.29.5&platform=unknown&pmmEnabled=false&sidecarsUsed=false\": context deadline exceeded", "errorVerbose": "Get \"https://check.percona.com/versions/v1/pg-operator/2.4.1/disabled?customResourceUid=e520622e-792c-45e3-8c7f-c420ca7df09b&databaseVersion=16&helmDeployCr=true&helmDeployOperator=true&kubeVersion=v1.29.5&platform=unknown&pmmEnabled=false&sidecarsUsed=false\": context deadline exceeded\nversion service apply\ngithub.com/percona/percona-postgresql-operator/percona/version.fetchVersions\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/version/version.go:77\ngithub.com/percona/percona-postgresql-operator/percona/version.EnsureVersion\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/version/version.go:34\ngithub.com/percona/percona-postgresql-operator/percona/controller/pgcluster.(*PGClusterReconciler).reconcileVersion\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/controller/pgcluster/version.go:33\ngithub.com/percona/percona-postgresql-operator/percona/controller/pgcluster.(*PGClusterReconciler).Reconcile\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/controller/pgcluster/controller.go:222\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:114\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:311\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:261\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:222\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1695\nfailed to send telemetry to https://check.percona.com\ngithub.com/percona/percona-postgresql-operator/percona/version.EnsureVersion\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/version/version.go:36\ngithub.com/percona/percona-postgresql-operator/percona/controller/pgcluster.(*PGClusterReconciler).reconcileVersion\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/controller/pgcluster/version.go:33\ngithub.com/percona/percona-postgresql-operator/percona/controller/pgcluster.(*PGClusterReconciler).Reconcile\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/controller/pgcluster/controller.go:222\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:114\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:311\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:261\nsigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2\n\t/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:222\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1695"}
github.com/percona/percona-postgresql-operator/percona/controller/pgcluster.(*PGClusterReconciler).Reconcile
	/go/src/github.com/percona/percona-postgresql-operator/percona/controller/pgcluster/controller.go:222
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Reconcile
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:114
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).reconcileHandler
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:311
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).processNextWorkItem
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:261
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller).Start.func2.2
	/go/pkg/mod/sigs.k8s.io/controller-runtime@v0.18.4/pkg/internal/controller/controller.go:222
2024-10-02T14:39:50.735+0330	ERROR	get latest backup	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "PerconaPGCluster": {"name":"pg-db","namespace":"postgres-ai"}, "namespace": "postgres-ai", "name": "pg-db", "reconcileID": "f987342e-1135-4c68-9270-6c4873e73edc", "error": "no completed backups found", "errorVerbose": "no completed backups found\ngithub.com/percona/percona-postgresql-operator/percona/watcher.getLatestBackup\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/watcher/wal.go:129\ngithub.com/percona/percona-postgresql-operator/percona/watcher.WatchCommitTimestamps\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/watcher/wal.go:65\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1695"}
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1695
2024-10-02T14:40:00.736+0330	ERROR	get latest backup	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "PerconaPGCluster": {"name":"pg-db","namespace":"postgres-ai"}, "namespace": "postgres-ai", "name": "pg-db", "reconcileID": "f987342e-1135-4c68-9270-6c4873e73edc", "error": "no completed backups found", "errorVerbose": "no completed backups found\ngithub.com/percona/percona-postgresql-operator/percona/watcher.getLatestBackup\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/watcher/wal.go:129\ngithub.com/percona/percona-postgresql-operator/percona/watcher.WatchCommitTimestamps\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/watcher/wal.go:65\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1695"}
runtime.goexit
	/usr/local/go/src/runtime/asm_amd64.s:1695
2024-10-02T14:40:10.736+0330	ERROR	get latest backup	{"controller": "perconapgcluster", "controllerGroup": "pgv2.percona.com", "controllerKind": "PerconaPGCluster", "PerconaPGCluster": {"name":"pg-db","namespace":"postgres-ai"}, "namespace": "postgres-ai", "name": "pg-db", "reconcileID": "f987342e-1135-4c68-9270-6c4873e73edc", "error": "no completed backups found", "errorVerbose": "no completed backups found\ngithub.com/percona/percona-postgresql-operator/percona/watcher.getLatestBackup\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/watcher/wal.go:129\ngithub.com/percona/percona-postgresql-operator/percona/watcher.WatchCommitTimestamps\n\t/go/src/github.com/percona/percona-postgresql-operator/percona/watcher/wal.go:65\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1695"}
runtime.goexit
...

Additional Information:

it should be mentioned that it is going to be setup on an airgaped kubernetes cluster.

Sergey_Pronin · October 4, 2024, 12:55pm

@Ahmad_Abdolmaleki

At first I should mention that I’m Ok with version 2.3.X of the pg-operator and pg-db.

What do you mean? Did it solve any issues for you?

Do you have this issue only with airgapped clusters or you have it for regular ones as well?

Try beta of Ivee by Percona now for free

Ahmad_Abdolmaleki · October 5, 2024, 11:05am

sorry.

It was my mistake. just some tipo in values.yaml for resources section!
I hadn’t check the postgres deployment logs and I’d just checked the operator log, and it made me fall in a wrong way. sorry again.

Topic		Replies	Views
Release Date Percona Operator for PostgreSQL 2.0.0 Percona Operator for PostgreSQL	6	1233	April 3, 2023
PostgreSQL cluster creation doesn't work on a different namespace (than pgo) Percona Operator for PostgreSQL percona , postgres	19	2963	March 22, 2022
I am creating percona postgres operator and cluster is showing initializing from long time Percona Operator for PostgreSQL percona	1	898	September 4, 2023
Need help with upgrade from pg-db v1.x to 2.2.0 Percona Operator for PostgreSQL	1	699	July 7, 2023
Pgbouncer cannot connect to server Percona Operator for PostgreSQL	3	5158	February 22, 2022