Query Analytics : Interval out of sequence

Percona Monitoring and Management (PMM) PMM 1.x
1

I cannot get query analytics to be processed from a node :
[TABLE]
[TR]
[TD]2016-10-10T09:59:00.001140141Z[/TD]
[TD]qan-analyzer-3fba67e0[/TD]
[TD]warning[/TD]
[TD]Skipping interval ‘194 2016-10-10 09:58:00 UTC to 2016-10-10 09:59:00 UTC (0-0)’ because interval ‘193 2016-10-10 09:57:00 UTC to 2016-10-10 09:58:00 UTC (0-0)’ is still being parsed[/TD]
[/TR]
[TR]
[TD]2016-10-10T09:58:38.017831004Z[/TD]
[TD]data-sender[/TD]
[TD]info[/TD]
[TD]at 2016-10-10 09:58:38 UTC: 0 files, 0, 2ms, 0.00 Mbps net util, 0.00 Mbps net speed[/TD]
[/TR]
[TR]
[TD]2016-10-10T09:58:14.991883367Z[/TD]
[TD]agent[/TD]
[TD]info[/TD]
[TD]Cmd ok: Reply[Cmd:Version Error:‘’ Id:b8a20c79-905d-4b35-66d0-1aaf8e20f5f7][/TD]
[/TR]
[TR]
[TD]2016-10-10T09:58:14.986035177Z[/TD]
[TD]agent[/TD]
[TD]info[/TD]
[TD]Cmd begin: Cmd[Service:agent Cmd:Version Ts:‘2016-10-10 09:58:14.986477595 +0000 UTC’ User:api AgentUUID: Id:b8a20c79-905d-4b35-66d0-1aaf8e20f5f7][/TD]
[/TR]
[TR]
[TD]2016-10-10T09:58:00.001775856Z[/TD]
[TD]qan-analyzer-3fba67e0-worker[/TD]
[TD]warning[/TD]
[TD]Interval out of sequence: got 193, expected 192[/TD]
[/TR]
[TR]
[TD]2016-10-10T09:57:35.017027378Z[/TD]
[TD]data-sender[/TD]
[TD]info[/TD]
[TD]at 2016-10-10 09:57:35 UTC: 0 files, 0, 2ms, 0.00 Mbps net util, 0.00 Mbps net speed[/TD]
[/TR]
[TR]
[TD]2016-10-10T09:57:14.992363352Z[/TD]
[TD]agent[/TD]
[TD]info[/TD]
[TD]Cmd ok: Reply[Cmd:Version Error:‘’ Id:2f93b7fd-1369-456c-553b-d88127ab9659][/TD]
[/TR]
[TR]
[TD]2016-10-10T09:57:14.986084264Z[/TD]
[TD]agent[/TD]
[TD]info[/TD]
[TD]Cmd begin: Cmd[Service:agent Cmd:Version Ts:‘2016-10-10 09:57:14.986502808 +0000 UTC’ User:api AgentUUID: Id:2f93b7fd-1369-456c-553b-d88127ab9659][/TD]
[/TR]
[/TABLE]

Any ideas ?

2

What do you have in /var/log/pmm-mysql-queries*.log? What’s the query source slowlog or perfschema?

3

from the log →

2016/10/10 17:55:00.001738 WARNING qan-analyzer-3fba67e0 Skipping interval ‘610 2016-10-10 16:54:00 UTC to 2016-10-10 16:55:00 UTC (0-0)’ because interval ‘609 2016-10-10 16:53:00 UTC to 2016-10-10 16:54:00 UTC (0-0)’ is still being parsed
2016/10/10 17:56:00.001728 WARNING qan-analyzer-3fba67e0-worker Interval out of sequence: got 611, expected 610

Using performance schema

4

Same kind of issue in the logs

2016/10/10 19:42:00.002049 WARNING qan-analyzer-3fba67e0-worker Interval out of sequence: got 717, expected 716
2016/10/10 19:43:00.001290 WARNING qan-analyzer-3fba67e0 Skipping interval ‘718 2016-10-10 18:42:00 UTC to 2016-10-10 18:43:00 UTC (0-0)’ because interval ‘717 2016-10-10 18:41:00 UTC to 2016-10-10 18:42:00 UTC (0-0)’ is still being parsed
2016/10/10 19:44:00.018866 WARNING qan-analyzer-3fba67e0-worker Interval out of sequence: got 719, expected 718
2016/10/10 19:45:00.001248 WARNING qan-analyzer-3fba67e0 Skipping interval ‘720 2016-10-10 18:44:00 UTC to 2016-10-10 18:45:00 UTC (0-0)’ because interval ‘719 2016-10-10 18:43:00 UTC to 2016-10-10 18:44:00 UTC (0-0)’ is still being parsed

And we are using Performance Schema - its set to automatic in the settings.

It was working - but we had an outage on the server - is there some way i can reset things ? im happy to lose any previous data - i guess i could reinstall server and client ?

5

May be system time is out of sync?