Not the answer you need?
Register and ask your own question!

Can I backup remote databases from my local server

KaminiVijayKaminiVijay EntrantCurrent User Role Beginner
Hi,
I am using mysqldump so far for taking daily backups of my Production databases. It takes around 6 to 7 hours for 210 GB of data and thus looking for other backup methods.

I have one single util server where I run mysqldump for all my production servers with one single script. I store my backup files in the same server. It is really easy to maintain.

Is that possible with Xtrabackup? Do I have to install and run xtrabackup in all my production servers? I can see there are options to transfer the backup files to any remote server. But I need to know whether I can run xtrabackup from a remote server connecting all my database servers as in mysqldump.

What are the options for it?


Thanks,

Comments

  • gmousegmouse Mod Squad Inactive User Role Beginner
    Xtrabackup needs access to the filesystem whereas mysqldump only connects to the MySQL server. I haven't seen any attempts to use NFS to access files on the db-server.
  • stevetoldmestevetoldme Entrant Current User Role Beginner
    I have used XtraBackup to back up remote servers to a local server. In fact I use this method a lot when I want to create a slave in a different geographic location. First I would suggest reading the XtraBackup Manual so you understand the differences between mysqldump and XtraBackup as they are very different.

    If you determine you can use XtraBackup in your situation then I can share what I have done in the past in hopes that you can use part of it in your situation.

    In this example lets says we have two locations or data centers (DC1 and DC2) and that you have a MySQL server (A) at DC1 that you want to back up to DC2.

    Because you want to back up a remote server to a local server, I will assume you may be connected over a VPN (which I have used this method for) or other network link.

    I suggest using pigz for compression over gzip as pigz can use multiple processors. So if possible, install pigz on A at DC1 ( google pigz )

    We are also going to make use of the "stream" option in XtraBackup and netcat (nc)

    Please read the XtraBackup documentation to make sure you select the correct options for your situation.

    At DC1 on A I run:
    innobackupex --user=username --password=password --stream=tar ./ | pigz | nc -l 1234

    At DC2 on the server I want to receive the back up at I run in the directory I want to store the back up:
    nc 1234 | gunzip | tar ixvf - 2> xtrabackup.log

    Note, this will store your entire MySQL data directory uncompressed at DC2 on your back up server. This is useful for creating a slave at DC2 and there are great directions on this in teh Xtrabackup Manual.

    I have done this with 600 GB databases in 2-3 hours over a VPN and much quicker on a 1GB network ( where A server had 16 cores).


    You could also just send the file like:

    innobackupex --user=username --password=password --stream=tar ./ | pigz | ssh [email protected]_server "cat - > /backupdirectory/mysql_backup.tar.gz"


    There are other great options you may need such as --slave-info and --safe-slave-backup and if the locking at the end of the back up is an issue you can use the --no-lock option and then use pt-table-checksum and pt-table-sync after you create your slave to bring it in line with your master. This is a bit more advanced, and while I have done it several times, I used Percona Support to do it! ( worth the investment trust me!)
  • KaminiVijayKaminiVijay Entrant Current User Role Beginner
    Thank you for your replies. Answered my question.

    And Steve, thanks for the tips. I already have tried the option you have explained to run the backup and move it to a remote server. Was using bzip2. I am new to Xtrabackup, will keep exploring the other options and get back soon with more questions.
  • SupriyaSupriya Current User Role Contributor

    I have 2tb of mysql data to be migrated as quick as possible over same network on another server. Can you tell if I use dedicated CPU and RAM, will it be faster? If yes, then how much should I dedicatedly use?

Sign In or Register to comment.

MySQL, InnoDB, MariaDB and MongoDB are trademarks of their respective owners.
Copyright ©2005 - 2020 Percona LLC. All rights reserved.