SST parallel not working

Hi,
We have two nodes percona xtradb cluster with one arbiter.

We have configured in my.cnf with this settings:

[xtrabackup]
compress
parallel=6

When cluster transfer SST, only transfer in one thread and not in 6.

Server version: 5.6.21-70.1-56-log Percona XtraDB Cluster (GPL), Release rel70.1, Revision 938, WSREP version 25.8, wsrep_25.8.r4150

Anybody with this behavior?

Best regards.

Can you please share mysql error log from donor and joiner and along with that backup log to check further. Also, what version of Xtrabackup you are using ?

$ xtrabackup --version

HI Mirfan,

Thanks for your help

xtrabackup version is the same on the two nodes:

xtrabackup version 2.2.12 based on MySQL server 5.6.24 Linux (x86_64) (revision id: 8726828)

Node1 (donor) Log


2015-09-16 16:44:30 14094 [Note] WSREP: SSL handshake successful, remote endpoint ssl://1X8.1X5.1X3.2X9:50283 local endpoint ssl://8X.9X.2X3.X2:4567 cipher: AES128-SHA compression: zlib compression
2015-09-16 16:44:30 14094 [Note] WSREP: (4c54e5cb, 'ssl://0.0.0.0:4567') address 'ssl://8X.9X.2X3.X2:4567' pointing to uuid 4c54e5cb is blacklisted, skipping
2015-09-16 16:44:30 14094 [Note] WSREP: (4c54e5cb, 'ssl://0.0.0.0:4567') address 'ssl://8X.9X.2X3.X2:4567' pointing to uuid 4c54e5cb is blacklisted, skipping
2015-09-16 16:44:30 14094 [Note] WSREP: (4c54e5cb, 'ssl://0.0.0.0:4567') address 'ssl://8X.9X.2X3.X2:4567' pointing to uuid 4c54e5cb is blacklisted, skipping
2015-09-16 16:44:30 14094 [Note] WSREP: (4c54e5cb, 'ssl://0.0.0.0:4567') turning message relay requesting on, nonlive peers:
2015-09-16 16:44:30 14094 [Note] WSREP: declaring 48d0060e at ssl://1X8.32.2X4.17:4567 stable
2015-09-16 16:44:30 14094 [Note] WSREP: declaring 70b10eaa at ssl://1X8.1X5.1X3.2X9:4567 stable
2015-09-16 16:44:30 14094 [Note] WSREP: (4c54e5cb, 'ssl://0.0.0.0:4567') address 'ssl://8X.9X.2X3.X2:4567' pointing to uuid 4c54e5cb is blacklisted, skipping
2015-09-16 16:44:30 14094 [Note] WSREP: (4c54e5cb, 'ssl://0.0.0.0:4567') address 'ssl://8X.9X.2X3.X2:4567' pointing to uuid 4c54e5cb is blacklisted, skipping
2015-09-16 16:44:30 14094 [Note] WSREP: (4c54e5cb, 'ssl://0.0.0.0:4567') address 'ssl://8X.9X.2X3.X2:4567' pointing to uuid 4c54e5cb is blacklisted, skipping
2015-09-16 16:44:30 14094 [Note] WSREP: (4c54e5cb, 'ssl://0.0.0.0:4567') address 'ssl://8X.9X.2X3.X2:4567' pointing to uuid 4c54e5cb is blacklisted, skipping
2015-09-16 16:44:30 14094 [Note] WSREP: Node 48d0060e state prim
2015-09-16 16:44:30 14094 [Note] WSREP: view(view_id(PRIM,48d0060e,1510) memb {
48d0060e,0
4c54e5cb,0
70b10eaa,0
} joined {
} left {
} partitioned {
})
2015-09-16 16:44:30 14094 [Note] WSREP: save pc into disk
2015-09-16 16:44:30 14094 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3
2015-09-16 16:44:30 14094 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2015-09-16 16:44:30 14094 [Note] WSREP: STATE EXCHANGE: sent state msg: 707090cd-5c81-11e5-8c09-7b24f3bbafa0
2015-09-16 16:44:30 14094 [Note] WSREP: STATE EXCHANGE: got state msg: 707090cd-5c81-11e5-8c09-7b24f3bbafa0 from 0 (garb)
2015-09-16 16:44:30 14094 [Note] WSREP: STATE EXCHANGE: got state msg: 707090cd-5c81-11e5-8c09-7b24f3bbafa0 from 1 (nodo1)
2015-09-16 16:44:30 14094 [Note] WSREP: STATE EXCHANGE: got state msg: 707090cd-5c81-11e5-8c09-7b24f3bbafa0 from 2 (nodo2)
2015-09-16 16:44:30 14094 [Note] WSREP: Quorum results:
version = 3,
component = PRIMARY,
conf_id = 544,
members = 2/3 (joined/total),
act_id = 10972359,
last_appl. = 0,
protocols = 0/6/3 (gcs/repl/appl),
group UUID = 52715674-b8c9-11e3-8f0f-265b2adb500e
2015-09-16 16:44:30 14094 [Note] WSREP: Flow-control interval: [28, 28]
2015-09-16 16:44:30 14094 [Note] WSREP: New cluster view: global state: 52715674-b8c9-11e3-8f0f-265b2adb500e:10972359, view# 545: Primary, number of nodes: 3, my index: 1, protocol version 3
2015-09-16 16:44:30 14094 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2015-09-16 16:44:30 14094 [Note] WSREP: REPL Protocols: 6 (3, 2)
2015-09-16 16:44:30 14094 [Note] WSREP: Service thread queue flushed.
2015-09-16 16:44:30 14094 [Note] WSREP: Assign initial position for certification: 10972359, protocol version: 3
2015-09-16 16:44:30 14094 [Note] WSREP: Service thread queue flushed.
2015-09-16 16:44:31 14094 [Note] WSREP: Member 2.0 (nodo2) requested state transfer from '*any*'. Selected 1.0 (nodo1)(SYNCED) as donor.
2015-09-16 16:44:31 14094 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 10972366)
2015-09-16 16:44:31 14094 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2015-09-16 16:44:31 14094 [Note] WSREP: Running: 'wsrep_sst_xtrabackup-v2 --role 'donor' --address '1X8.1X5.1X3.2X9:4444/xtrabackup_sst//1' --auth 'sstuser:sstpass' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --defaults-file '/etc/mysql/my.cnf' '' --gtid '52715674-b8c9-11e3-8f0f-265b2adb500e:10972366''
2015-09-16 16:44:31 14094 [Note] WSREP: sst_donor_thread signaled with 0
WSREP_SST: [INFO] Streaming with xbstream (20150916 16:44:31.597)
WSREP_SST: [INFO] Using socat as streamer (20150916 16:44:31.599)
WSREP_SST: [INFO] Using /tmp/tmp.y1Eb2DPFhI as innobackupex temporary directory (20150916 16:44:31.780)
WSREP_SST: [INFO] Streaming GTID file before SST (20150916 16:44:31.785)
WSREP_SST: [INFO] Evaluating xbstream -c ${INFO_FILE} | socat -u stdio TCP:1X8.1X5.1X3.2X9:4444; RC=( ${PIPESTATUS[@]} ) (20150916 16:44:31.787)
WSREP_SST: [INFO] Sleeping before data transfer for SST (20150916 16:44:31.807)
2015-09-16 16:44:33 14094 [Note] WSREP: (4c54e5cb, 'ssl://0.0.0.0:4567') turning message relay requesting off
WSREP_SST: [INFO] Streaming the backup to joiner at 1X8.1X5.1X3.2X9 4444 (20150916 16:44:41.813)
WSREP_SST: [INFO] Evaluating innobackupex --defaults-file=/etc/mysql/my.cnf --no-version-check $tmpopts $INNOEXTRA --galera-info --stream=$sfmt $itmpdir 2>${DATA}/innobackup.backup.log | socat -u stdio TCP:1X8.1X5.1X3.2X9:4444; RC=( ${PIPESTATUS[@]} ) (20150916 16:44:41.816)
WSREP_SST: [INFO] Total time on donor: 0 seconds (20150916 16:53:19.530)
WSREP_SST: [INFO] Cleaning up temporary directories (20150916 16:53:19.532)
2015-09-16 16:53:19 14094 [Note] WSREP: 1.0 (nodo1): State transfer to 2.0 (nodo2) complete.
2015-09-16 16:53:19 14094 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 10973114)
2015-09-16 16:53:19 14094 [Note] WSREP: Member 1.0 (nodo1) synced with group.
2015-09-16 16:53:19 14094 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 10973114)
2015-09-16 16:53:19 14094 [Note] WSREP: Synchronized with group, ready for connections
2015-09-16 16:53:19 14094 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2015-09-16 17:02:18 14094 [Note] WSREP: 2.0 (nodo2): State transfer from 1.0 (nodo1) complete.

Node2 (Joiner) Log


2015-09-16 16:44:31 0 [Note] WSREP: wsrep_start_position var submitted: '00000000-0000-0000-0000-000000000000:-1'
2015-09-16 16:44:31 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details).
2015-09-16 16:44:31 5891 [Note] WSREP: Read nil XID from storage engines, skipping position init
2015-09-16 16:44:31 5891 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/libgalera_smm.so'
2015-09-16 16:44:31 5891 [Note] WSREP: wsrep_load(): Galera 3.8(rf6147dd) by Codership Oy <info&#64;codership.com> loaded successfully.
2015-09-16 16:44:31 5891 [Note] WSREP: CRC-32C: using "slicing-by-8" algorithm.
2015-09-16 16:44:31 5891 [Warning] WSREP: Could not open saved state file for reading: /var/lib/mysql//grastate.dat
2015-09-16 16:44:31 5891 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1
2015-09-16 16:44:31 5891 [Note] WSREP: Passing config to GCS: base_host = 1X8.1X5.1X3.2X9; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = false; pc.ignore_quorum = false; pc.ignore_sb = false; pc.npvo = false; pc.reco
2015-09-16 16:44:31 5891 [Note] WSREP: Service thread queue flushed.
2015-09-16 16:44:31 5891 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1
2015-09-16 16:44:31 5891 [Note] WSREP: wsrep_sst_grab()
2015-09-16 16:44:31 5891 [Note] WSREP: Start replication
2015-09-16 16:44:31 5891 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1
2015-09-16 16:44:31 5891 [Note] WSREP: protonet asio version 0
2015-09-16 16:44:31 5891 [Note] WSREP: Using CRC-32C for message checksums.
2015-09-16 16:44:31 5891 [Note] WSREP: initializing ssl context
2015-09-16 16:44:31 5891 [Note] WSREP: backend: asio
2015-09-16 16:44:31 5891 [Warning] WSREP: access file(gvwstate.dat) failed(No such file or directory)
2015-09-16 16:44:31 5891 [Note] WSREP: restore pc from disk failed
2015-09-16 16:44:31 5891 [Note] WSREP: GMCast version 0
2015-09-16 16:44:31 5891 [Note] WSREP: (70b10eaa, 'ssl://0.0.0.0:4567') listening at ssl://0.0.0.0:4567
2015-09-16 16:44:31 5891 [Note] WSREP: (70b10eaa, 'ssl://0.0.0.0:4567') multicast: , ttl: 1
2015-09-16 16:44:31 5891 [Note] WSREP: EVS version 0
2015-09-16 16:44:31 5891 [Note] WSREP: gcomm: connecting to group 'clustername', peer '8X.9X.2X3.X2:,1X8.1X5.1X3.2X9:'
2015-09-16 16:44:31 5891 [Note] WSREP: SSL handshake successful, remote endpoint ssl://1X8.1X5.1X3.2X9:33244 local endpoint ssl://1X8.1X5.1X3.2X9:4567 cipher: AES128-SHA compression: zlib compression
2015-09-16 16:44:31 5891 [Note] WSREP: SSL handshake successful, remote endpoint ssl://1X8.1X5.1X3.2X9:4567 local endpoint ssl://1X8.1X5.1X3.2X9:33244 cipher: AES128-SHA compression: zlib compression
2015-09-16 16:44:31 5891 [Warning] WSREP: (70b10eaa, 'ssl://0.0.0.0:4567') address 'ssl://1X8.1X5.1X3.2X9:4567' points to own listening address, blacklisting
2015-09-16 16:44:31 5891 [Note] WSREP: SSL handshake successful, remote endpoint ssl://8X.9X.2X3.X2:4567 local endpoint ssl://1X8.1X5.1X3.2X9:50283 cipher: AES128-SHA compression: zlib compression
2015-09-16 16:44:31 5891 [Note] WSREP: (70b10eaa, 'ssl://0.0.0.0:4567') address 'ssl://1X8.1X5.1X3.2X9:4567' pointing to uuid 70b10eaa is blacklisted, skipping
2015-09-16 16:44:31 5891 [Note] WSREP: (70b10eaa, 'ssl://0.0.0.0:4567') turning message relay requesting on, nonlive peers: ssl://1X8.32.2X4.17:4567 
2015-09-16 16:44:32 5891 [Note] WSREP: gcomm: connected
2015-09-16 16:44:32 5891 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
2015-09-16 16:44:32 5891 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
2015-09-16 16:44:32 5891 [Note] WSREP: Opened channel 'clustername'
2015-09-16 16:44:32 5891 [Note] WSREP: Waiting for SST to complete.
2015-09-16 16:44:32 5891 [Note] WSREP: SSL handshake successful, remote endpoint ssl://1X8.32.2X4.17:4567 local endpoint ssl://1X8.1X5.1X3.2X9:47082 cipher: AES128-SHA compression: zlib compression
2015-09-16 16:44:32 5891 [Note] WSREP: (70b10eaa, 'ssl://0.0.0.0:4567') address 'ssl://1X8.1X5.1X3.2X9:4567' pointing to uuid 70b10eaa is blacklisted, skipping
2015-09-16 16:44:32 5891 [Note] WSREP: (70b10eaa, 'ssl://0.0.0.0:4567') address 'ssl://1X8.1X5.1X3.2X9:4567' pointing to uuid 70b10eaa is blacklisted, skipping
2015-09-16 16:44:32 5891 [Note] WSREP: (70b10eaa, 'ssl://0.0.0.0:4567') address 'ssl://1X8.1X5.1X3.2X9:4567' pointing to uuid 70b10eaa is blacklisted, skipping
2015-09-16 16:44:32 5891 [Note] WSREP: declaring 48d0060e at ssl://1X8.32.2X4.17:4567 stable
2015-09-16 16:44:32 5891 [Note] WSREP: declaring 4c54e5cb at ssl://8X.9X.2X3.X2:4567 stable
2015-09-16 16:44:32 5891 [Note] WSREP: Node 48d0060e state prim
2015-09-16 16:44:32 5891 [Note] WSREP: view(view_id(PRIM,48d0060e,1510) memb {
48d0060e,0
4c54e5cb,0
70b10eaa,0
} joined {
} left {
} partitioned {
})
2015-09-16 16:44:32 5891 [Note] WSREP: save pc into disk
2015-09-16 16:44:32 5891 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2015-09-16 16:44:32 5891 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2015-09-16 16:44:32 5891 [Note] WSREP: STATE EXCHANGE: sent state msg: 707090cd-5c81-11e5-8c09-7b24f3bbafa0
2015-09-16 16:44:32 5891 [Warning] WSREP: Action message in non-primary configuration from member 1
2015-09-16 16:44:32 5891 [Note] WSREP: STATE EXCHANGE: got state msg: 707090cd-5c81-11e5-8c09-7b24f3bbafa0 from 0 (garb)
2015-09-16 16:44:32 5891 [Note] WSREP: STATE EXCHANGE: got state msg: 707090cd-5c81-11e5-8c09-7b24f3bbafa0 from 1 (nodo1)
2015-09-16 16:44:32 5891 [Note] WSREP: STATE EXCHANGE: got state msg: 707090cd-5c81-11e5-8c09-7b24f3bbafa0 from 2 (nodo2)
2015-09-16 16:44:32 5891 [Note] WSREP: Quorum results:
version = 3,
component = PRIMARY,
conf_id = 544,
members = 2/3 (joined/total),
act_id = 10972359,
last_appl. = -1,
protocols = 0/6/3 (gcs/repl/appl),
group UUID = 52715674-b8c9-11e3-8f0f-265b2adb500e
2015-09-16 16:44:32 5891 [Note] WSREP: Flow-control interval: [28, 28]
2015-09-16 16:44:32 5891 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 10972359)
2015-09-16 16:44:32 5891 [Note] WSREP: State transfer required: 
Group state: 52715674-b8c9-11e3-8f0f-265b2adb500e:10972359
Local state: 00000000-0000-0000-0000-000000000000:-1
2015-09-16 16:44:32 5891 [Note] WSREP: New cluster view: global state: 52715674-b8c9-11e3-8f0f-265b2adb500e:10972359, view# 545: Primary, number of nodes: 3, my index: 2, protocol version 3
2015-09-16 16:44:32 5891 [Warning] WSREP: Gap in state sequence. Need state transfer.
2015-09-16 16:44:32 5891 [Note] WSREP: Running: 'wsrep_sst_xtrabackup-v2 --role 'joiner' --address '1X8.1X5.1X3.2X9' --auth 'sstuser:sstpass' --datadir '/var/lib/mysql/' --defaults-file '/etc/mysql/my.cnf' --parent '5891' '' '
WSREP_SST: [INFO] Streaming with xbstream (20150916 16:44:32.310)
WSREP_SST: [INFO] Using socat as streamer (20150916 16:44:32.311)
WSREP_SST: [INFO] Evaluating timeout -k 110 100 socat -u TCP-LISTEN:4444,reuseaddr stdio | xbstream -x; RC=( ${PIPESTATUS[&#64;]} ) (20150916 16:44:32.485)
2015-09-16 16:44:32 5891 [Note] WSREP: Prepared SST request: xtrabackup-v2|1X8.1X5.1X3.2X9:4444/xtrabackup_sst//1
2015-09-16 16:44:32 5891 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
2015-09-16 16:44:32 5891 [Note] WSREP: REPL Protocols: 6 (3, 2)
2015-09-16 16:44:32 5891 [Note] WSREP: Service thread queue flushed.
2015-09-16 16:44:32 5891 [Note] WSREP: Assign initial position for certification: 10972359, protocol version: 3
2015-09-16 16:44:32 5891 [Note] WSREP: Service thread queue flushed.
2015-09-16 16:44:32 5891 [Warning] WSREP: Failed to prepare for incremental state transfer: Local state UUID (00000000-0000-0000-0000-000000000000) does not match group state UUID (52715674-b8c9-11e3-8f0f-265b2adb500e): 1 (Operation not permitted)
at galera/src/replicator_str.cpp:prepare_for_IST():456. IST will be unavailable.
2015-09-16 16:44:32 5891 [Note] WSREP: Member 2.0 (nodo2) requested state transfer from '*any*'. Selected 1.0 (nodo1)(SYNCED) as donor.
2015-09-16 16:44:32 5891 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 10972366)
2015-09-16 16:44:32 5891 [Note] WSREP: Requesting state transfer: success, donor: 1
WSREP_SST: [INFO] Proceeding with SST (20150916 16:44:33.199)
WSREP_SST: [INFO] Cleaning the existing datadir (20150916 16:44:33.201)

==== Deleting Database Files ====



==== Deleting Database Files ==== 
WSREP_SST: [INFO] Evaluating socat -u TCP-LISTEN:4444,reuseaddr stdio | xbstream -x; RC=( ${PIPESTATUS[&#64;]} ) (20150916 16:44:34.122)
2015-09-16 16:44:35 5891 [Note] WSREP: (70b10eaa, 'ssl://0.0.0.0:4567') turning message relay requesting off
2015-09-16 16:53:20 5891 [Note] WSREP: 1.0 (nodo1): State transfer to 2.0 (nodo2) complete.
2015-09-16 16:53:20 5891 [Note] WSREP: Member 1.0 (nodo1) synced with group.
WSREP_SST: [INFO] Compressed qpress files found (20150916 16:53:30.772)
WSREP_SST: [INFO] Decompression with 8 threads (20150916 16:53:30.775)
WSREP_SST: [INFO] Evaluating find /var/lib/mysql/ -type f -name '*.qp' -printf '%p\n%h\n' | xargs -n 2 qpress -T8d (20150916 16:53:30.776)
WSREP_SST: [INFO] Removing qpress files after decompression (20150916 16:58:40.900)
WSREP_SST: [INFO] Preparing the backup at /var/lib/mysql/ (20150916 16:58:41.027)
WSREP_SST: [INFO] Evaluating innobackupex --no-version-check --apply-log $rebuildcmd ${DATA} &>${DATA}/innobackup.prepare.log (20150916 16:58:41.029)
WSREP_SST: [INFO] Galera co-ords from recovery: 52715674-b8c9-11e3-8f0f-265b2adb500e:10973103 (20150916 17:02:18.596)
WSREP_SST: [INFO] Total time on joiner: 0 seconds (20150916 17:02:18.598)
WSREP_SST: [INFO] Removing the sst_in_progress file (20150916 17:02:18.600)
2015-09-16 17:02:18 5891 [Note] WSREP: SST complete, seqno: 10973103
2015-09-16 17:02:18 5891 [Note] Plugin 'FEDERATED' is disabled.
2015-09-16 17:02:18 7f8ecdf2e720 InnoDB: Warning: Using innodb_locks_unsafe_for_binlog is DEPRECATED. This option may be removed in future releases. Please use READ COMMITTED transaction isolation level instead, see http://dev.mysql.com/doc/refman/5.6/en/set-transaction.html.
2015-09-16 17:02:18 5891 [Note] InnoDB: Using atomics to ref count buffer pool pages
2015-09-16 17:02:18 5891 [Note] InnoDB: The InnoDB memory heap is disabled
2015-09-16 17:02:18 5891 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
2015-09-16 17:02:18 5891 [Note] InnoDB: Memory barrier is not used
2015-09-16 17:02:18 5891 [Note] InnoDB: Compressed tables use zlib 1.2.7
2015-09-16 17:02:18 5891 [Note] InnoDB: Using Linux native AIO
2015-09-16 17:02:18 5891 [Note] InnoDB: Not using CPU crc32 instructions
2015-09-16 17:02:18 5891 [Note] InnoDB: Initializing buffer pool, size = 4.0G
2015-09-16 17:02:18 5891 [Note] InnoDB: Completed initialization of buffer pool
2015-09-16 17:02:18 5891 [Note] InnoDB: Highest supported file format is Barracuda.
2015-09-16 17:02:19 5891 [Note] InnoDB: 128 rollback segment(s) are active.
2015-09-16 17:02:19 5891 [Note] InnoDB: Waiting for purge to start
2015-09-16 17:02:19 5891 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.21-70.1 started; log sequence number 35390587755
2015-09-16 17:02:19 5891 [Warning] No existing UUID has been found, so we assume that this is the first time that this server has been started. Generating a new UUID: ed43a881-5c83-11e5-a03f-020000260fd4.
2015-09-16 17:02:19 5891 [Note] RSA private key file not found: /var/lib/mysql//private_key.pem. Some authentication plugins will not work.
2015-09-16 17:02:19 5891 [Note] RSA public key file not found: /var/lib/mysql//public_key.pem. Some authentication plugins will not work.
2015-09-16 17:02:19 5891 [Note] Server hostname (bind-address): '0.0.0.0'; port: 3306
2015-09-16 17:02:19 5891 [Note] - '0.0.0.0' resolves to '0.0.0.0';
2015-09-16 17:02:19 5891 [Note] Server socket created on IP: '0.0.0.0'.
2015-09-16 17:02:19 5891 [Note] Event Scheduler: Loaded 0 events
2015-09-16 17:02:19 5891 [Note] WSREP: Signalling provider to continue.
2015-09-16 17:02:19 5891 [Note] WSREP: inited wsrep sidno 2
2015-09-16 17:02:19 5891 [Note] WSREP: SST received: 52715674-b8c9-11e3-8f0f-265b2adb500e:10973103
2015-09-16 17:02:19 5891 [Note] /usr/sbin/mysqld: ready for connections.
Version: '5.6.21-70.1-56-log' socket: '/var/run/mysqld/mysqld.sock' port: 3306 Percona XtraDB Cluster (GPL), Release rel70.1, Revision 938, WSREP version 25.8, wsrep_25.8.r4150
2015-09-16 17:02:19 5891 [Note] WSREP: 2.0 (nodo2): State transfer from 1.0 (nodo1) complete.
2015-09-16 17:02:19 5891 [Note] WSREP: Shifting JOINER -> JOINED (TO: 10974013)
2015-09-16 17:03:37 5891 [Note] WSREP: Member 2.0 (nodo2) synced with group.
2015-09-16 17:03:37 5891 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 10974067)
2015-09-16 17:03:40 5891 [Note] WSREP: Synchronized with group, ready for connections

Any ideas??