PMM: Process "qan-api2" always restarts and exits with exit status 1

Description:

PMM runs in a StatefulSet in Kubernetes, PMM can be started, runs and has a connection to the database. However, the PMM CLient logs indicate that the process named ‘qan-api2’ was started but unexpectedly terminated with exit status 1.

Steps to Reproduce:

Installation via Helm Chart

Version:

PMM:
pmm-client:2.40.1
pmm-server:2.40.1

Kubernetes:
Client Version: v1.24.12
Kustomize Version: v4.5.4
Server Version: v1.24.13

Logs:


2023-11-24 09:16:35,565 INFO exited: qan-api2 (exit status 1; not expected) 2023-11-24T09:16:35.574740865Z 2023-11-24 09:16:35,574 INFO spawned: ‘qan-api2’ with pid 114507

2023-11-24 09:16:35,613 INFO exited: qan-api2 (exit status 1; not expected) 2023-11-24T09:16:37.525030898Z 2023-11-24 09:16:37,523 INFO spawned: ‘qan-api2’ with pid 114513 2023-11-24T09:16:38.124959549Z 2023-11-24 09:16:38,124 INFO exited: qan-api2 (exit status 1; not expected)

2023-11-24 09:16:40,570 INFO spawned: ‘qan-api2’ with pid 114520

2023-11-24 09:16:41,090 INFO exited: qan-api2 (exit status 1; not expected) 2023-11-24T09:16:44.527034355Z 2023-11-24 09:16:44,526 INFO spawned: ‘qan-api2’ with pid 114526

2023-11-24 09:16:44,550 INFO exited: qan-api2 (exit status 1; not expected)

2023-11-24 09:16:49,135 INFO spawned: ‘qan-api2’ with pid 114533 2023-11-24T09:16:49.173565505Z 2023-11-24 09:16:49,173 INFO exited: qan-api2 (exit status 1; not expected) 2023-11-24T09:16:54.522295554Z 2023-11-24 09:16:54,521 INFO spawned: ‘qan-api2’ with pid 114541 2023-11-24T09:16:54.556994067Z 2023-11-24 09:16:54,556 INFO exited: qan-api2 (exit status 1; not expected)

2023-11-24 09:17:01,048 INFO spawned: ‘qan-api2’ with pid 114566

2023-11-24 09:17:01,079 INFO exited: qan-api2 (exit status 1; not expected) 2023-11-24T09:17:08.520779784Z 2023-11-24 09:17:08,520 INFO spawned: ‘qan-api2’ with pid 114572

2023-11-24 09:17:08,544 INFO exited: qan-api2 (exit status 1; not expected)

2023-11-24 09:17:17,522 INFO spawned: ‘qan-api2’ with pid 114578

2023-11-24 09:17:17,554 INFO exited: qan-api2 (exit status 1; not expected)

2023-11-24 09:17:27,522 INFO spawned: ‘qan-api2’ with pid 114600

I would be grateful for any help!

Hi @Marvin.K, it might be because of not enough resources allocated. Could you share how much memory did you allocate?

Thank you