hi im creating a 5node PXC 5.7 as geo multimaster setup

In one location there are 3 PXC nodes all are in synch and working fine,now I’m trying to add two more nodes in different location with IP reachability and 3306 port opening . after configuring the nodes in the 4rth and 5th node in wsrep.cnf file. MySQL is not not starting .giving error-can anyone help me pls.

Hi @balajisivamani
Can you please provide the error log ?
Also, in the meanwhile: can you check that the Galera required ports are open? 4444 4567 and 4568

yep i just opened those ports ,so my scenario is 3 nodes at location A and 2 nodes at location B multimaster setup. yes those ports are opened at both the end FW’s. 

systemctl restart mysqlJob for mysql.service failed because the control process exited with error code.See “systemctl status mysql.service” and “journalctl -xe” for details.root@spxc1:~# systemctl status mysql● mysql.service - LSB: Start and stop the mysql (Percona XtraDB Cluster) daemon   Loaded: loaded (/etc/init.d/mysql; generated)   Active: failed (Result: exit-code) since Thu 2020-05-07 14:36:52 UTC; 17s ago     Docs: man:systemd-sysv-generator(8)  Process: 27930 ExecStop=/etc/init.d/mysql stop (code=exited, status=0/SUCCESS)  Process: 28060 ExecStart=/etc/init.d/mysql start (code=exited, status=1/FAILURE)
May 07 14:36:12 spxc1 systemd[1]: Starting LSB: Start and stop the mysql (Percona XtraDB Cluster) daemon…May 07 14:36:13 spxc1 mysql[28060]:  * Starting MySQL (Percona XtraDB Cluster) database server mysqldMay 07 14:36:13 spxc1 /etc/init.d/mysql[28129]: MySQL PID not found, pid_file detected/guessed: /var/run/mysqld/mysqld.pidMay 07 14:36:52 spxc1 mysql[28060]:  * The server quit without updating PID file (/var/run/mysqld/mysqld.pid).May 07 14:36:52 spxc1 mysql[28060]:    …fail!May 07 14:36:52 spxc1 systemd[1]: mysql.service: Control process exited, code=exited status=1May 07 14:36:52 spxc1 systemd[1]: mysql.service: Failed with result ‘exit-code’.May 07 14:36:52 spxc1 systemd[1]: Failed to start LSB: Start and stop the mysql (Percona XtraDB Cluster) daemon.

and this happens when i give the location A node 1 Ip address in the 4rth node which is in location B .wsrep_cluster_address=gcomm

Thanks, but could you provide the mysql error log too? and the cnf file for all the nodes as well? 

in errorlog file nothing is recorded,the file is empty and cnf file you mean wsrep.cnf file 

# Path to Galera librarywsrep_provider=/usr/lib/galera3/libgalera_smm.so
# Cluster connection URL contains IPs of nodes#If no IP is found, this implies that a new cluster needs to be created,#in order to do that you need to bootstrap this nodewsrep_cluster_address=gcomm://all the five nodes IPs
# In order for Galera to work correctly binlog format should be ROWbinlog_format=ROW
# MyISAM storage engine has only experimental supportdefault_storage_engine=InnoDB
# Slave thread to use#wsrep_slave_threads= 8
#wsrep_log_conflicts
# This changes how InnoDB autoincrement locks are managed and is a requirement for Galerainnodb_autoinc_lock_mode=2
# Node IP address#wsrep_node_address=192.168.70.63# Cluster namewsrep_cluster_name=pxc-cluster
#If wsrep_node_name is not specified,  then system hostname will be usedwsrep_node_name=pxc-cluster-node-2wsrep_node_address=*Node IP *
#pxc_strict_mode allowed values: DISABLED,PERMISSIVE,ENFORCING,MASTERpxc_strict_mode=ENFORCING
# SST methodwsrep_sst_method=xtrabackup-v2wsrep_sst_auth=sstuser:passw0rd#Authentication for SST method#wsrep_sst_auth="sstuser:s3cretPass"

its the same for all all the nodes except nodeip and name differs. please check and help to resolve

hi @DGB any info on this ?

Apparently the mysqld process itself cannot start at all, independently of Galera. If you take out or comment the galera-specific configuration variables, does the MySQL start?

i will test that ,let me also tell you that ,when I don’t provide the location A primary  node address and give the actual node address ,then MySQL process is starting.

hey @dgb ya when i comment the galera section the MySQL process is started great. so whats next ?shall I check the replication and other stuff

this the output:
show status like ‘wsrep%’;±-------------------------±---------------------+| Variable_name            | Value                |±-------------------------±---------------------+| wsrep_cluster_conf_id    | 18446744073709551615 || wsrep_cluster_size       | 0                    || wsrep_cluster_state_uuid |                      || wsrep_cluster_status     | Disconnected         || wsrep_connected          | OFF                  || wsrep_local_bf_aborts    | 0                    || wsrep_local_index        | 18446744073709551615 || wsrep_provider_name      |                      || wsrep_provider_vendor    |                      || wsrep_provider_version   |                      || wsrep_ready              | ON                   |

@DGB have you had a chance to see the issue?

I was re reading and i saw that you didn’t provided the output of journalctl -xe when the node fails attempting to join the cluster, can you provide that please?

hi pls find the output:

he start-up result is RESULT.May 14 05:09:50 pxc1 systemd-timesyncd[7519]: Timed out waiting for reply from 91.189.89.199:123 (ntp.ubuntu.com).May 14 05:10:01 pxc1 systemd-timesyncd[7519]: Timed out waiting for reply from 91.189.89.198:123 (ntp.ubuntu.com).May 14 05:10:11 pxc1 systemd-timesyncd[7519]: Timed out waiting for reply from 91.189.91.157:123 (ntp.ubuntu.com).May 14 05:10:17 pxc1 sudo[10216]: pam_unix(sudo:auth): authentication failure; logname=admin uid=1000 euid=0 tty=/dev/pts/0 ruser=admin rhost=  user=mediaMay 14 05:10:21 pxc1 systemd-timesyncd[7519]: Timed out waiting for reply from 91.189.94.4:123 (ntp.ubuntu.com).May 14 05:10:24 pxc1 sudo[10216]: admin : TTY=pts/0 ; PWD=/home/admin ; USER=root ; COMMAND=/bin/bashMay 14 05:10:24 pxc1 sudo[10216]: pam_unix(sudo:session): session opened for user root by admin(uid=0)May 14 05:11:27 pxc1 systemd[1]: Starting LSB: Start and stop the mysql (Percona XtraDB Cluster) daemon…-- Subject: Unit mysql.service has begun start-up-- Defined-By: systemd-- Support: http://www.ubuntu.com/support---- Unit mysql.service has begun starting up.May 14 05:11:27 pxc1 mysql[10240]:  * Starting MySQL (Percona XtraDB Cluster) database server mysqldMay 14 05:11:27 pxc1 /etc/init.d/mysql[10294]: MySQL PID not found, pid_file detected/guessed: /var/run/mysqld/mysqld.pidMay 14 05:11:29 pxc1 mysql[10240]:    …done.May 14 05:11:29 pxc1 systemd[1]: Started LSB: Start and stop the mysql (Percona XtraDB Cluster) daemon.-- Subject: Unit mysql.service has finished start-up-- Defined-By: systemd-- Support: http://www.ubuntu.com/support---- Unit mysql.service has finished starting up.