# Is it possible to turn the QAN including Clickhouse off? **URL:** \ **Category:** PMM 2.x\ **Created:** [February 7, 2023, 1:46am UTC](https://forums.percona.com/t/is-it-possible-to-turn-the-qan-including-clickhouse-off/19952 "2023-02-07T01:46:59Z")\ **Posts on this page:** 16\ **Page:** 1
**Author:** ![chadr](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/chadr/32/3923_2.png) [@chadr](https://forums.percona.com/u/chadr)\ **Post date:** [February 7, 2023, 1:47am UTC](https://forums.percona.com/t/is-it-possible-to-turn-the-qan-including-clickhouse-off/19952/1 "2023-02-07T01:47:00Z")
I’m using `2.25.0` version of PMM. At the moment, I don’t use the QAN feature so I would like to turn it off to reduce memory usage as the Clickhouse consumes too much memory. ☹ Is it possible? If true, how to do that? Thanks. 🙂 ---
**Author:** ![Michael\_Coburn](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/michael_coburn/32/18_2.png) [@Michael\_Coburn](https://forums.percona.com/u/Michael_Coburn)\ **Post date:** [February 7, 2023, 3:24am UTC](https://forums.percona.com/t/is-it-possible-to-turn-the-qan-including-clickhouse-off/19952/2 "2023-02-07T03:24:25Z")
Hi @chadr thanks for posting to the Percona forums! There isn’t a supported way of turning off Clickhouse in PMM. Possibly the simplest would be to remove the executable bit on the binary `/usr/bin/clickhouse`, for example: ```auto chmod -x /usr/bin/clickhouse ``` ---
**Author:** ![chadr](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/chadr/32/3923_2.png) [@chadr](https://forums.percona.com/u/chadr)\ **Post date:** [February 7, 2023, 4:40am UTC](https://forums.percona.com/t/is-it-possible-to-turn-the-qan-including-clickhouse-off/19952/3 "2023-02-07T04:40:47Z")
Thanks for your reply. It would be great if PMM could support such the feature in future. 🙂 ---
**Author:** ![Michael\_Coburn](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/michael_coburn/32/18_2.png) [@Michael\_Coburn](https://forums.percona.com/u/Michael_Coburn)\ **Post date:** [February 7, 2023, 4:47am UTC](https://forums.percona.com/t/is-it-possible-to-turn-the-qan-including-clickhouse-off/19952/4 "2023-02-07T04:47:04Z")
@chadr What kind of resource usage are you seeing from Clickhouse? An idle server should be no more than 100 MB Another approach could be to define a non-existent query source. For example, with MySQL you could say `--query-source=slowlog` but have `slow_query_log=OFF` ---
**Author:** ![chadr](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/chadr/32/3923_2.png) [@chadr](https://forums.percona.com/u/chadr)\ **Post date:** [February 7, 2023, 5:57am UTC](https://forums.percona.com/t/is-it-possible-to-turn-the-qan-including-clickhouse-off/19952/5 "2023-02-07T05:57:27Z")
> What kind of resource usage are you seeing from Clickhouse? An idle server should be no more than 100 MB I’m monitoring about 77 MongoDB instances at same time. > ps aux > USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND > … > root 126 2.2 3.8 83259844 15080300 ? SLl Feb06 43:01 /usr/bin/clickhouse-server --config-file=/etc/clickhouse-server/config.xml Currently, it consumes around 15GB of memory. ---
**Author:** ![Ceri\_Williams](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/ceri_williams/32/1218_2.png) [@Ceri\_Williams](https://forums.percona.com/u/Ceri_Williams)\ **Post date:** [February 8, 2023, 3:14pm UTC](https://forums.percona.com/t/is-it-possible-to-turn-the-qan-including-clickhouse-off/19952/6 "2023-02-08T15:14:09Z")
@chadr you could remove the agent that is used. Here is an example for removing just the MySQL performance\_schema agent for an instance. ```auto ❯ pmm-admin list --json | jq '.agent[] | select(.agent_type == "QAN_MYSQL_PERFSCHEMA_AGENT").agent_id' -r /agent_id/ef5bc4e2-26f5-47d8-a4a9-bcdfdde5d503 ❯ pmm-admin inventory remove agent /agent_id/ef5bc4e2-26f5-47d8-a4a9-bcdfdde5d503 Agent removed. ❯ pmm-admin list Service type Service name Address and port Service ID MySQL ps80 127.0.0.1:33060 /service_id/2bc07e95-598b-46ad-bf1a-ff99f208e0e4 Agent type Status Metrics Mode Agent ID Service ID Port pmm_agent Connected /agent_id/aa50b08b-f825-4a55-9fb3-3fc0b755d400 0 node_exporter Running push /agent_id/b636aeb2-f0be-4166-952e-d3e6b8f41f19 42000 mysqld_exporter Running push /agent_id/6a0e7827-4187-4978-9769-82b0e7290fd4 /service_id/2bc07e95-598b-46ad-bf1a-ff99f208e0e4 42003 vmagent Running push /agent_id/f15751b8-69dd-4a62-abe6-64f9659c0f1f 42001 ``` It should be `QAN_MONGODB_PROFILER_AGENT` instead of `QAN_MYSQL_PERFSCHEMA_AGENT` in your case, but you would be able to easily add this into any automation for new nodes, or even to remove any ones that already have it active. You can then leave ClickHouse alone and just ignore QAN in the UI. ---
**Author:** ![chadr](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/chadr/32/3923_2.png) [@chadr](https://forums.percona.com/u/chadr)\ **Post date:** [February 9, 2023, 1:30am UTC](https://forums.percona.com/t/is-it-possible-to-turn-the-qan-including-clickhouse-off/19952/7 "2023-02-09T01:30:57Z")
> [@Ceri\_Williams](#): > > but you would be able to easily add this into any automation for new nodes, or even to remove any ones that already have it active. Thank you for your reply! Yes. It would be an issue for me. Then, I have a question. I’m adding a MongoDB using below command. So is it possible to guarantee that I can see the `QAN_MONGODB_PROFILER_AGENT` right after the command ends like as below. ```auto # Register a MongoDB instance pmm-admin add mongodb --cluster=${PMM_ADMIN_MONGODB_CLUSTER} --skip-connection-check # Run the command to retrieve an Agent ID of `QAN_MONGODB_PROFILER_AGENT` pmm-admin list --json ``` ---
**Author:** ![Ceri\_Williams](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/ceri_williams/32/1218_2.png) [@Ceri\_Williams](https://forums.percona.com/u/Ceri_Williams)\ **Post date:** [February 9, 2023, 9:20am UTC](https://forums.percona.com/t/is-it-possible-to-turn-the-qan-including-clickhouse-off/19952/8 "2023-02-09T09:20:08Z")
> So is it possible to guarantee that I can see the `QAN_MONGODB_PROFILER_AGENT` right after the command ends like as below. That will depend upon a few things, so what you need to do is wait for it to appear and then remove it, failing after some period of time of retries if unable to find it running. Here is an Ansible snippet that shows you the idea, checking to make sure that the agent is present: ```yaml - name: Check agent status ansible.builtin.command: pmm-admin status --json register: pmm_client_status_json until: ( pmm_client_status_json.stdout | from_json | json_query('pmm_agent_status.agents[?agent_type == `QAN_MONGODB_PROFILER_AGENT`].agent_id') | length > 0) retries: 3 delay: 10 no_log: true ``` Such a task would: - Complete immediately when the agent is present in the output - Perform a loop of checks (3 retries, 10s delay) when the agent is absent - Fail after being unable to find an agent ID In your case, where you want it to be absent and so you should allow the task to fail, so long as it wasn’t a complete failure (e.g. nothing is registered and pmm-admin cannot talk to the server). You could change the `until` and add `failed_when`, e.g.: ```yaml until: ( (pmm_client_status_json.rc is defined and pmm_client_status_json.rc == 0) and ( pmm_client_status_json.stdout | from_json | json_query('pmm_agent_status.agents[?agent_type == `QAN_MONGODB_PROFILER_AGENT`].agent_id') | length > 0) ) failed_when: (pmm_client_status_json.rc is undefined or pmm_client_status_json.rc > 0) ``` ---
**Author:** ![chadr](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/chadr/32/3923_2.png) [@chadr](https://forums.percona.com/u/chadr)\ **Post date:** [February 9, 2023, 10:40am UTC](https://forums.percona.com/t/is-it-possible-to-turn-the-qan-including-clickhouse-off/19952/9 "2023-02-09T10:40:58Z")
I tried to unregister the `QAN_MONGODB_PROFILER_AGENT` but there is no effect. ☹ The clickhouse-server still consumes such memory. Is it possible to be related with below message? ```auto 2023.02.03 07:03:13.936153 [165] {} Application: Setting max_server_memory_usage was set to 453.21 GiB (503.57 GiB available * 0.90 max_server_memory_usage_to_ram_ratio) ``` In fact, I’m running the PMM Server on docker container. ---
**Author:** ![Ceri\_Williams](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/ceri_williams/32/1218_2.png) [@Ceri\_Williams](https://forums.percona.com/u/Ceri_Williams)\ **Post date:** [February 9, 2023, 12:03pm UTC](https://forums.percona.com/t/is-it-possible-to-turn-the-qan-including-clickhouse-off/19952/10 "2023-02-09T12:03:55Z")
> Is it possible to be related with below message? Yes, that explains the high usage that you are looking to reduce. You will find this in the ClickHouse config: ```auto 0 ``` Now, changing that is possible, but it would be reverted if you replaced the container image, although you can of course rebuild using PMM as the base and adjusting that value. Just checking if it can be done without messing with the image, because I think that most options do not change what ClickHouse will see ---
**Author:** ![Ceri\_Williams](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/ceri_williams/32/1218_2.png) [@Ceri\_Williams](https://forums.percona.com/u/Ceri_Williams)\ **Post date:** [February 9, 2023, 12:49pm UTC](https://forums.percona.com/t/is-it-possible-to-turn-the-qan-including-clickhouse-off/19952/11 "2023-02-09T12:49:10Z")
Whilst I can control memory usage as a whole, I couldn’t make ClickHouse see anything different when it auto-configures its memory usage, so I have created [PMM-11593](https://jira.percona.com/browse/PMM-11593) ---
**Author:** ![chadr](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/chadr/32/3923_2.png) [@chadr](https://forums.percona.com/u/chadr)\ **Post date:** [February 10, 2023, 4:55am UTC](https://forums.percona.com/t/is-it-possible-to-turn-the-qan-including-clickhouse-off/19952/12 "2023-02-10T04:55:02Z")
It seems the ClickHouse requires much memory basically. Please see this: [Usage Recommendations | ClickHouse Docs](https://clickhouse.com/docs/en/operations/tips/#ram) They recommends to run the ClickHouse with at least 32GB memory. ☹ > If your system has less than 16 GB of RAM, you may experience various memory exceptions because default settings do not match this amount of memory. The recommended amount of RAM is 32 GB or more. You can use ClickHouse in a system with a small amount of RAM, even with 2 GB of RAM, but it requires additional tuning and can ingest at a low rate. ---
**Author:** ![makromedia](https://avatars.discourse-cdn.com/v4/letter/m/858c86/32.png) [@makromedia](https://forums.percona.com/u/makromedia)\ **Post date:** [March 10, 2023, 5:48pm UTC](https://forums.percona.com/t/is-it-possible-to-turn-the-qan-including-clickhouse-off/19952/13 "2023-03-10T17:48:49Z")
Yes, the ClickHouse server eats RAM like you wouldn’t believe. Just made a fresh install on Ubuntu an it takes about 12GB of RAM only in idle!! Please add a switch to disable this in one of your next releases as it completely cripples the system ---
**Author:** ![Ceri\_Williams](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/ceri_williams/32/1218_2.png) [@Ceri\_Williams](https://forums.percona.com/u/Ceri_Williams)\ **Post date:** [March 13, 2023, 9:21am UTC](https://forums.percona.com/t/is-it-possible-to-turn-the-qan-including-clickhouse-off/19952/14 "2023-03-13T09:21:28Z")
@makromedia welcome to the forum! My [earlier comment](https://forums.percona.com/t/is-it-possible-to-turn-the-qan-including-clickhouse-off/19952/11) shows the ticket that tracks changes relating to this issue 🙂 ---
**Author:** ![makromedia](https://avatars.discourse-cdn.com/v4/letter/m/858c86/32.png) [@makromedia](https://forums.percona.com/u/makromedia)\ **Post date:** [March 13, 2023, 1:33pm UTC](https://forums.percona.com/t/is-it-possible-to-turn-the-qan-including-clickhouse-off/19952/15 "2023-03-13T13:33:33Z")
@Ceri_Williams Thank you for our reply and the thint for the link to the ticket. Woul be great if the memory usage of Clickhouse could be set in a simple way via GUI. I’m completely new to Percona, am I right that Clickhouse is just resposible for tracking all the queries on the Percona server? So if it is disabled the QAN feature within the PMM will not be available any longer? ---
**Author:** ![Ceri\_Williams](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/ceri_williams/32/1218_2.png) [@Ceri\_Williams](https://forums.percona.com/u/Ceri_Williams)\ **Post date:** [March 13, 2023, 2:24pm UTC](https://forums.percona.com/t/is-it-possible-to-turn-the-qan-including-clickhouse-off/19952/16 "2023-03-13T14:24:26Z")
> [@makromedia](#): > > I’m completely new to Percona, am I right that Clickhouse is just resposible for tracking all the queries on the Percona server? You can find out more information about the [architecture of PMM Server](https://docs.percona.com/percona-monitoring-and-management/details/architecture.html#pmm-server_1) in the docs.