# PMM Server 2 Eats all memory

**URL:** <https://forums.percona.com/t/pmm-server-2-eats-all-memory/8281>\
**Category:** PMM 2.x\
**Tags:** pmm\
**Created:** [November 18, 2020, 5:49am UTC](https://forums.percona.com/t/pmm-server-2-eats-all-memory/8281 "2020-11-18T05:49:39Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![Rick](https://avatars.discourse-cdn.com/v4/letter/r/9f8e36/32.png) [@Rick](https://forums.percona.com/u/Rick)\
**Post date:** [November 18, 2020, 5:49am UTC](https://forums.percona.com/t/pmm-server-2-eats-all-memory/8281/1 "2020-11-18T05:49:39Z")

</div>

Hi,

We are using pmm-server (1.x) for two years in one docker container with this specs:

8GB of RAM

2vCPU

23 clients configured ( almost 200 databases)

All the customers have configured pmm-agent with mysql.

All works perfect.

But we upgraded our container to pmm-server 2.11. After all the configuration, our docker container dies in 3 minutes.

After some research whe see with the same scenario can only configure 6 clients (pmm-admin). If we configure more than these, our containers eats all memory and docker kill the container (OOM)

Is there any option with version 2 i missing?

We are planning to rollback to the previus version of pmm. If we can take the same configuration with version 2

Attach our docker stats with 6 pmm-clients configured:

 ![docker_stats1.PNG](https://us1.discourse-cdn.com/flex019/uploads/percona1/original/1X/79818b30ce8afaf436f5b11dcc85f0491cf4489f.png)

---

<div class="post-metadata">

**Author:** ![Vadim\_Yalovets](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/vadim_yalovets/32/43_2.png) [@Vadim\_Yalovets](https://forums.percona.com/u/Vadim_Yalovets)\
**Post date:** [November 18, 2020, 6:30am UTC](https://forums.percona.com/t/pmm-server-2-eats-all-memory/8281/2 "2020-11-18T06:30:44Z")

</div>

Hi Rick,

Prometheus will be replaced by VictoriaMetrics for metrics storing in the next pmm-server release.

It will significantly reduce memory usage.

pmm-server 2.12 is planed to be released in two weeks.

Also I have linked your post to the ticket that is related to checking Memory Consumption with many nodes.

[https://jira.percona.com/browse/PMM-4158](https://jira.percona.com/browse/PMM-4158)

---

<div class="post-metadata">

**Author:** ![steve.hoffman](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/steve.hoffman/32/66_2.png) [@steve.hoffman](https://forums.percona.com/u/steve.hoffman)\
**Post date:** [November 18, 2020, 10:58am UTC](https://forums.percona.com/t/pmm-server-2-eats-all-memory/8281/3 "2020-11-18T10:58:01Z")

</div>

your consumption sounds really high…I’m monitoring 10 nodes and using ~750MB on my pmm-server container, our pmmdemo site is monitoring 30 nodes and only using about 4.2GB. We have a general recommendation [here](https://www.percona.com/doc/percona-monitoring-and-management/2.x/faq.html) on sizing but it’s definitely padded to be safe.

I’m curious to know what’s consuming all the memory, could you do the following and let us know:

get a bash prompt inside the docker container: docker exec -it pmm-server bash

and see what the main consumer of memory is: ps -aux

That would at least give a place to start checking logs for something running haywire.

My immediate questions would be around: scrape interval: do you have things collecting at the highest resolution? Have you installed any additional grafana plugins? How did you transition to PMM2 from PMM1: whole new server, sid-by-side. What is your retention period and how active are users in consuming the graphs?

Those are all the things I can think of off the top of my head that would be the big offenders. VictoriaMetrics will certainly reduce the footprint but sounds like there’s something else going wrong.

---

<div class="post-metadata">

**Author:** ![Rick](https://avatars.discourse-cdn.com/v4/letter/r/9f8e36/32.png) [@Rick](https://forums.percona.com/u/Rick)\
**Post date:** [November 19, 2020, 2:57am UTC](https://forums.percona.com/t/pmm-server-2-eats-all-memory/8281/4 "2020-11-19T02:57:44Z")

</div>

Hi,

We created a new container following the pmm manual installation. We not installed any component/plugin to grafana. Only the components with the container.

Here is the screen capture of ps -aux:

 ![scPMM_mem.PNG](https://us1.discourse-cdn.com/flex019/uploads/percona1/original/1X/ba4c5cb75bbb68ca764bdf72effab1312c3182ed.png)

Seams Prometheus is eating all the memory with this new version. Only two users can access to this server and the use is very lowest. May be access one time a day.
