We are experiencing a problem with bringing up new XtraDB Cluster installations in both the latest 5.6 and 5.7 releases. The problem looks like this on PXC 5.7:
When bootstrapped from a newly created data directory, the first node does not properly enter PRIMARY state.
Because it’s not primary, you can’t execute any statements that change data.
You can’t force the node primary by setting wsrep_provider_options=‘pc.bootstrap=true’, because you can’t do anything until you set a permanent superuser password to replace the temporary password created by MySQL 5.7.
You can’t set a valid superuser password because with the node non-primary, you can’t execute any statements. So you can’t even look at global status to see what the state actually is.
So on 5.7.14, you’re stuck in a catch-22 situation. You can’t set the node primary without first setting a new superuser password, and you can’t set a new superuser password without setting the node primary.
On 5.6.32, the problem seems to be related — you still end up with your bootstrapped node non-primary, though you don’t have a forced temporary password to reset. You can execute the command to set the node primary, but it doesn’t work:
mysql> set global wsrep_provider_options=‘pc.bootstrap=true’;
ERROR 1210 (HY000): Incorrect arguments to SET
Investigating this further, it seems that this is because the pc.bootstrap parameter no longer exists:
2016-11-23T21:47:42.232304Z 2 [Warning] WSREP: Unknown parameter ‘pc.bootstrap’
2016-11-23T21:47:42.232418Z 2 [ERROR] WSREP: Set options returned 7
I can find no documentation stating what has replaced it.
It looks as though the following MAY be why the node is not properly coming up primary:
2016-11-23T15:43:15.983090Z 0 [ERROR] Incorrect definition of table performance_schema.replication_connection_status: expected column ‘RECEIVED_TRANSACTION_SET’ at position 7 to have type longtext, found type text.
2016-11-23T15:43:15.984024Z 0 [ERROR] Incorrect definition of table performance_schema.replication_group_member_stats: expected column ‘COUNT_TRANSACTIONS_ROWS_VALIDATING’ at position 6, found ‘COUNT_TRANSACTIONS_VALIDATING’.
It’s not clear to me what can be done by the user to fix this.
Can anyone assist?