Nodes not connecting to XDB server

Hi there,

Im stuck a little and would appreciate some support / suggestions, and would gladly reward solution.

Im going off the webinar posted on the 19th, the install and setup of an xdb cluster.

Keen on getting this connection error , have checked firewall settings, ie telnet.

I have 3 ubuntu 12.04 nodes, all identical set up, with same sql root pw.

Here is the error log…;
120925 16:05:50 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
120925 16:05:50 [Note] Flashcache bypass: disabled
120925 16:05:50 [Note] Flashcache setup error is : ioctl failed

120925 16:05:50 [Note] Plugin ‘FEDERATED’ is disabled.
120925 16:05:50 InnoDB: The InnoDB memory heap is disabled
120925 16:05:50 InnoDB: Mutexes and rw_locks use GCC atomic builtins
120925 16:05:50 InnoDB: Compressed tables use zlib 1.2.3
120925 16:05:50 InnoDB: Using Linux native AIO
120925 16:05:50 InnoDB: Initializing buffer pool, size = 128.0M
120925 16:05:50 InnoDB: Completed initialization of buffer pool
120925 16:05:50 InnoDB: highest supported file format is Barracuda.
120925 16:05:50 InnoDB: Waiting for the background threads to start
120925 16:05:51 Percona XtraDB (http://www.percona.com) 1.1.8-rel28.1 started; log sequence number 1598139
120925 16:05:51 [Note] Server hostname (bind-address): ‘0.0.0.0’; port: 3306
120925 16:05:51 [Note] - ‘0.0.0.0’ resolves to ‘0.0.0.0’;
120925 16:05:51 [Note] Server socket created on IP: ‘0.0.0.0’.
120925 16:05:51 [Note] Event Scheduler: Loaded 0 events
120925 16:05:51 [Note] WSREP: Read nil XID from storage engines, skipping position init
120925 16:05:51 [Note] WSREP: wsrep_load(): loading provider library ‘/usr/lib/libgalera_smm.so’
120925 16:05:51 [Note] WSREP: wsrep_load(): Galera 2.2(r115) by Codership Oy <info&#64;codership.com> loaded succesfully.
120925 16:05:51 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1
120925 16:05:51 [Note] WSREP: Reusing existing ‘/var/lib/mysql//galera.cache’.

120925 16:05:51 [Note] WSREP: Passing config to GCS: base_host = 192.168.240.231; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 0.5; gcs.fc_limit = 16; gcs.fc_master_slave = NO; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = NO; replicator.causal_read_timeout = PT30S; replicator.commit_order = 3
120925 16:05:51 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1
120925 16:05:51 [Note] WSREP: Start replication
120925 16:05:51 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1
120925 16:05:51 [Note] WSREP: protonet asio version 0
120925 16:05:51 [Note] WSREP: backend: asio
120925 16:05:51 [Note] WSREP: GMCast version 0
120925 16:05:51 [Note] WSREP: (0edb85d0-06d7-11e2-0800-712845f61cee, ‘tcp://0.0.0.0:4567’) listening at tcp://0.0.0.0:4567
120925 16:05:51 [Note] WSREP: (0edb85d0-06d7-11e2-0800-712845f61cee, ‘tcp://0.0.0.0:4567’) multicast: , ttl: 1
120925 16:05:51 [Note] WSREP: EVS version 0
120925 16:05:51 [Note] WSREP: PC version 0
120925 16:05:51 [Note] WSREP: gcomm: connecting to group ‘my_wsrep_cluster’, peer ‘192.168.240.230:’
120925 16:05:54 [Warning] WSREP: no nodes coming from prim view, prim not possible
120925 16:05:54 [Note] WSREP: view(view_id(NON_PRIM,0edb85d0-06d7-11e2-0800-712845f61cee,1 ) memb {
0edb85d0-06d7-11e2-0800-712845f61cee,
} joined {
} left {
} partitioned {
})
120925 16:05:54 [Warning] WSREP: last inactive check more than PT1.5S ago, skipping check
120925 16:06:24 [Note] WSREP: view((empty))
120925 16:06:24 [ERROR] WSREP: failed to open gcomm backend connection: 110: failed to reach primary view: 110 (Connection timed out)
at gcomm/src/pc.cpp:connect():157
120925 16:06:24 [ERROR] WSREP: gcs/src/gcs_core.c:gcs_core_open():195: Failed to open backend connection: -110 (Connection timed out)
120925 16:06:24 [ERROR] WSREP: gcs/src/gcs.c:gcs_open():1290: Failed to open channel ‘my_wsrep_cluster’ at ‘gcomm://192.168.240.230’: -110 (Connection timed out)
120925 16:06:24 [ERROR] WSREP: gcs connect failed: Connection timed out
120925 16:06:24 [ERROR] WSREP: wsrep::connect() failed: 6
120925 16:06:24 [ERROR] Aborting

120925 16:06:24 [Note] WSREP: Service disconnected.

The Primary nodes config;

[mysqld]
server_id=1
binlog_format=ROW
log_bin=mysql-bin
wsrep_cluster_address=gcomm://
wsrep_provider=/usr/lib/libgalera_smm.so
datadir=/var/lib/mysql
tmpdir=/tmp

wsrep_slave_threads=4
wsrep_cluster_name=testdb
wsrep_sst_method=xtrabackup
wsrep_node_name=perconaxdb1

log_slave_updates

innodb_locks_unsafe_for_binlog=1
innodb_autoinc_lock_mode=2
innodb_buffer_pool_size=400M
innodb_log_file_size=64M

[mysqld_safe]
#wsrep_url= gcomm://192.168.240.230:4567,gcomm://192.168.240.231:4567,gc omm://192.168.240.232:4567,gcomm://

[client]
user=root
password=‘percona!’

And all other node config ;

[mysqld]
server_id=2
binlog_format=ROW
log_bin=mysql-bin
wsrep_cluster_address=gcomm://192.168.240.230
wsrep_provider=/usr/lib/libgalera_smm.so
datadir=/var/lib/mysql
tmpdir=/tmp

[client]
user=root
password=‘percona!’

#wsrep_provider_options=“gmcast.listen_addr=tcp://0.0.0.0:4567”
wsrep_slave_threads=4
wsrep_cluster_name=testdb
wsrep_sst_method=xtrabackup
wsrep_node_name=perconaxdb2

log_slave_updates

innodb_locks_unsafe_for_binlog=1
innodb_autoinc_lock_mode=2
innodb_buffer_pool_size=400M
innodb_log_file_size=64M