Our PMM server monitors 16 hosts and 59 MySQL instances. After adding all the linux:metrics and mysql:metrics source types, we have detected that the Memory Usage graph in the Cross Server Graphs dashboard started reporting an error when all the hosts were selected.
Adding one by one we were able to restrict the problem to the number of hosts (order doesn’t matter), basically when the number is > 68, the graph fails consistently with the following error:
Message:
a.data.data is undefined Stack trace:
b/this.query/</<@http://mysql-hxvm7-monitor-005:8000/graph/public/app/plugins/datasource/prometheus/datasource.js?bust=1486481238956:4:1767 f@http://mysql-hxvm7-monitor-005:8000/graph/public/app/boot.85c49108.js:48:28473 Pg@http://mysql-hxvm7-monitor-005:8000/graph/public/app/boot.85c49108.js:49:29427 b/this.query/<@http://mysql-hxvm7-monitor-005:8000/graph/public/app/plugins/datasource/prometheus/datasource.js?bust=1486481238956:4:1644 g@http://mysql-hxvm7-monitor-005:8000/graph/public/app/boot.85c49108.js:38:29545 h/<@http://mysql-hxvm7-monitor-005:8000/graph/public/app/boot.85c49108.js:38:29717 xc/this.$get</o.prototype.$eval@http://mysql-hxvm7-monitor-005:8000/graph/public/app/boot.85c49108.js:39:5353 xc/this.$get</o.prototype.$digest@http://mysql-hxvm7-monitor-005:8000/graph/public/app/boot.85c49108.js:39:3835 xc/this.$get</o.prototype.$apply@http://mysql-hxvm7-monitor-005:8000/graph/public/app/boot.85c49108.js:39:5638 x/i<@http://mysql-hxvm7-monitor-005:8000/graph/public/app/boot.85c49108.js:39:1804 f@http://mysql-hxvm7-monitor-005:8000/graph/public/app/boot.85c49108.js:37:15602 jb/k.defer/c<@http://mysql-hxvm7-monitor-005:8000/graph/public/app/boot.85c49108.js:37:17066
All the other graphs seem to work as expected.
Is there any limitation in place we are not aware of?
We tried to dig into the Docker container logs, but we didn’t find any clue.
Could you please help?
Thanks
Regards,
Alessio