We have a 3 node cluster setup, and it happens that nodes create a lot of gcache.page files and it leads to fulling disks on nodes and to node crash. Then node needs to be reinitialised and gcache.page.some_number files needs to be deleted. All those gcache.page files can full up the disks up to 90 GB, althought when node starts mysql data directory takes only 12 GB. It is Percona XtraDB Cluster 5.6. How can I limit the number of these files?
@taka-h: I don’t really understand the doc of gcache.keep_page_size - is this the number of files or is the the overall amounth of space required by gcache?
Is there any news on this issue? We have a three node cluster, and invariably after a few days to a week, we end up with a bunch of gcache.page.XXX files being created. The cluster itself is fine. I end up shutting down the node with the files (whichis the one getting all the writes), manually delete them, and start it back up.
-rw-------. 1 mysql mysql 134219048 Dec 11 18:27 galera.cache
-rw------- 1 mysql mysql 134217728 Dec 12 12:26 gcache.page.000000
-rw------- 1 mysql mysql 134217728 Dec 13 12:27 gcache.page.000001
-rw------- 1 mysql mysql 134217728 Dec 14 10:27 gcache.page.000002
-rw------- 1 mysql mysql 134217728 Dec 14 12:54 gcache.page.000003
-rw------- 1 mysql mysql 134217728 Dec 14 14:34 gcache.page.000004
-rw------- 1 mysql mysql 134217728 Dec 14 15:56 gcache.page.000005
-rw------- 1 mysql mysql 134217728 Dec 14 18:59 gcache.page.000006
-rw------- 1 mysql mysql 134217728 Dec 15 10:41 gcache.page.000007
-rw------- 1 mysql mysql 134217728 Dec 15 12:31 gcache.page.000008
-rw------- 1 mysql mysql 134217728 Dec 15 15:11 gcache.page.000009
-rw-rw---- 1 mysql mysql 133 Dec 10 19:32 GRA_9_888385.log
-rw-rw----. 1 mysql mysql 108 Dec 15 00:30 grastate.dat
-rw-rw---- 1 mysql mysql 265 Dec 3 20:24 gvwstate.dat
The algorithm for gcache page cleanup was changed in 5.6.35. However, gcache will not release the pages until it is safe to do so (until the data has been safely replicated to all the nodes). Do you have very large transactions? Also, the pages are freed in order they are created, so one early transaction could block the rest from being freed up.