Performance of SST with xbtream

Hi there,

I’m currently migrating an xtradb cluster 5.6 to 5.7 on a complete new hardware configuration.
Facts:

  • xtradb cluster 5.7.23-23-57
  • 4TB Raid-0 SSD / avg. 800mb/s
  • AMD 24-core
  • 128GB RAM
  • 10gbit switched connection
  • About 2TB DB (innodb)
  • 3 nodes setup

I was really excited to check out the replication performance, especially the cluster recovery for the migration process.
But after starting to connect another node to the cluster (no queries are running) the SST performance is not really what I expected:


# donor
encryption: using gcrypt 1.7.6-beta
2018-10-30T15:30:24.122000Z 0 [Note] WSREP: (9e511e63, 'tcp://0.0.0.0:4567') turning message relay requesting off
2018-10-30T15:30:33.645006Z WSREP_SST: [INFO] Streaming the backup to joiner at 192.168.200.11 4444
donor: => Rate:[ 336MiB/s] Avg:[ 339MiB/s] Elapsed:0:14:50 ETA 0:17:24

# joiner
encryption: using gcrypt 1.7.6-beta
2018-10-30T15:30:23.760007Z WSREP_SST: [INFO] Proceeding with SST.........
2018-10-30T15:30:23.791703Z WSREP_SST: [INFO] ............Waiting for SST streaming to complete!
2018-10-30T15:30:24.402283Z 0 [Note] WSREP: (4faee0a3, 'tcp://0.0.0.0:4567') turning message relay requesting off
joiner: => Rate:[ 333MiB/s] Avg:[ 335MiB/s] Elapsed:0:14:40 Bytes: 288GiB

The currently used settings:


[sst]
inno-apply-opts="--use-memory=32G"
inno-backup-opts="--parallel=4"
encrypt=0
progress=1

[xtrabackup]
use-memory=32G
parallel=4
compress-threads=4
rebuild-threads=4

Am i missing something completely or dies this look completely normal for my configuration?
I’m also wondering if there is still encryption used because of the “encryption: using gcrypt 1.7.6-beta”?

Thank you in advance for any advices/ideas!

Dom

What does innobackup.backup.log say?

Maybe try increasing ) but it may be worth a shot.