# SLOW incremental backup (mysql 5.7)

**URL:** <https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971>\
**Category:** MySQL & MariaDB\
**Tags:** mysql, percona\
**Created:** [December 7, 2022, 8:42am UTC](https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971 "2022-12-07T08:42:48Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![\_Sumit\_Debnath](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/_sumit_debnath/32/8589_2.png) [@\_Sumit\_Debnath](https://forums.percona.com/u/_Sumit_Debnath)\
**Post date:** [December 7, 2022, 8:42am UTC](https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971/1 "2022-12-07T08:42:48Z")

</div>

Hello  
We running a incremental right after the full backup is completing (1hr 45 min)

FULL:  
innobackupex --user=${MYSQLROOT} --password=${MYSQLPASS} --extra-lsndir=${BACKUP\_PATH} --compress --open-files-limit=100000 --stream=xbstream ${BACKUP\_PATH}${BACKUP\_DIRNAME} \> ${BACKUP\_PATH}${BACKUP\_DIRNAME}${DATESTAMP}.xbstream

Incremental:  
innobackupex --user=${MYSQLROOT} --password=${MYSQLPASS} --extra-lsndir=${BACKUP\_PATH} --compress --open-files-limit=100000 --incremental --incremental-lsn=${lsn} --stream=xbstream ${BACKUP\_PATH}${BACKUP\_DIRNAME} \> ${BACKUP\_PATH}${BACKUP\_DIRNAME}${DATESTAMP}.xbstream

Incremental Backup is also taking same time as Full backup.  
Any one can help?

innobackupex version  
= 2.4.24 Linux (x86\_64) (revision id: b4ee263)

Mysql 5.7

---

<div class="post-metadata">

**Author:** ![Ivan\_Groenewold](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/ivan_groenewold/32/6299_2.png) [@Ivan\_Groenewold](https://forums.percona.com/u/Ivan_Groenewold)\
**Post date:** [December 7, 2022, 11:58am UTC](https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971/2 "2022-12-07T11:58:21Z")

</div>

Hi, in order for incremental backup to be fast you need changed page tracking option: [XtraDB changed page tracking - Percona Server for MySQL](https://docs.percona.com/percona-server/5.7/management/changed_page_tracking.html)  
Do you have it enabled?

---

<div class="post-metadata">

**Author:** ![\_Sumit\_Debnath](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/_sumit_debnath/32/8589_2.png) [@\_Sumit\_Debnath](https://forums.percona.com/u/_Sumit_Debnath)\
**Post date:** [December 7, 2022, 3:54pm UTC](https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971/3 "2022-12-07T15:54:40Z")

</div>

Disabled currently  
Tried enabling it but got error  
`[ERROR] unknown variable 'innodb_track_changed_pages=1'`

---

<div class="post-metadata">

**Author:** ![matthewb](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/matthewb/32/34_2.png) [@matthewb](https://forums.percona.com/u/matthewb)\
**Post date:** [December 7, 2022, 7:06pm UTC](https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971/4 "2022-12-07T19:06:50Z")

</div>

@_Sumit_Debnath Are you using Percona Server MySQL 5.7? This feature is specific to Percona’s MySQL

Additionally, innobackupex is dead software. Please switch to xtrabackup. All of the same functionality exists.

---

<div class="post-metadata">

**Author:** ![\_Sumit\_Debnath](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/_sumit_debnath/32/8589_2.png) [@\_Sumit\_Debnath](https://forums.percona.com/u/_Sumit_Debnath)\
**Post date:** [December 7, 2022, 7:17pm UTC](https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971/5 "2022-12-07T19:17:23Z")

</div>

I’m not sure what is your question.  
I have a mysql server 5.7 which is 3 years old. And we are setting up percona for backup (POC)

---

<div class="post-metadata">

**Author:** ![\_Sumit\_Debnath](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/_sumit_debnath/32/8589_2.png) [@\_Sumit\_Debnath](https://forums.percona.com/u/_Sumit_Debnath)\
**Post date:** [December 7, 2022, 7:19pm UTC](https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971/6 "2022-12-07T19:19:06Z")

</div>

Ok I will switch. And update

---

<div class="post-metadata">

**Author:** ![matthewb](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/matthewb/32/34_2.png) [@matthewb](https://forums.percona.com/u/matthewb)\
**Post date:** [December 7, 2022, 8:12pm UTC](https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971/7 "2022-12-07T20:12:30Z")

</div>

Here are the commands we use in our [training class](https://percona.com/training)

```auto
$ mkdir /var/backups

$ FULLBACKUP=/var/backups/fullbase
$ xtrabackup --backup --parallel 4 --target-dir $FULLBACKUP

$ INCBACKUP=/var/backups/inc1
$ xtrabackup --backup --parallel 4 \
    --target-dir $INCBACKUP \
    --incremental-basedir $FULLBACKUP

```

---

<div class="post-metadata">

**Author:** ![\_Sumit\_Debnath](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/_sumit_debnath/32/8589_2.png) [@\_Sumit\_Debnath](https://forums.percona.com/u/_Sumit_Debnath)\
**Post date:** [December 12, 2022, 8:13am UTC](https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971/8 "2022-12-12T08:13:36Z")

</div>

Hi,  
I have modified my script to use xtrabackup but the incremental backup is taking 42 min while the full backup time was around 45 min.

---

<div class="post-metadata">

**Author:** ![matthewb](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/matthewb/32/34_2.png) [@matthewb](https://forums.percona.com/u/matthewb)\
**Post date:** [December 12, 2022, 1:00pm UTC](https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971/9 "2022-12-12T13:00:18Z")

</div>

Can you please provide the updated commands you are using? Did you add `--incremental-basedir` to your script?

---

<div class="post-metadata">

**Author:** ![\_Sumit\_Debnath](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/_sumit_debnath/32/8589_2.png) [@\_Sumit\_Debnath](https://forums.percona.com/u/_Sumit_Debnath)\
**Post date:** [December 12, 2022, 1:18pm UTC](https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971/10 "2022-12-12T13:18:27Z")

</div>

No I didn’t,I used --incremental-lsn. Because we remove the backup fron the directory after copying it to s3.  
`${PERCONA_BACKUP_COMMAND} --backup --user=${MYSQLROOT} --password=${MYSQLPASS} --parallel 4 --target-dir=${BACKUP_PATH}${BACKUP_DIRNAME} --compress --compress-threads=4 --open-files-limit=100000 --incremental-lsn=${lsn}`

---

<div class="post-metadata">

**Author:** ![matthewb](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/matthewb/32/34_2.png) [@matthewb](https://forums.percona.com/u/matthewb)\
**Post date:** [December 12, 2022, 3:25pm UTC](https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971/11 "2022-12-12T15:25:26Z")

</div>

Please re-read my previous message and check the parameter names.

---

<div class="post-metadata">

**Author:** ![\_Sumit\_Debnath](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/_sumit_debnath/32/8589_2.png) [@\_Sumit\_Debnath](https://forums.percona.com/u/_Sumit_Debnath)\
**Post date:** [December 13, 2022, 8:01pm UTC](https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971/12 "2022-12-13T20:01:38Z")

</div>

still same issue incremental backup is taking 45 min. (2gb incremental backup)

---

<div class="post-metadata">

**Author:** ![matthewb](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/matthewb/32/34_2.png) [@matthewb](https://forums.percona.com/u/matthewb)\
**Post date:** [December 13, 2022, 9:16pm UTC](https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971/13 "2022-12-13T21:16:39Z")

</div>

If your incremental and full are the same size, that means you are doing the incremental wrong and you need to reexamine my two previous examples and compare to your script.

---

<div class="post-metadata">

**Author:** ![\_Sumit\_Debnath](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/_sumit_debnath/32/8589_2.png) [@\_Sumit\_Debnath](https://forums.percona.com/u/_Sumit_Debnath)\
**Post date:** [December 13, 2022, 9:45pm UTC](https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971/14 "2022-12-13T21:45:40Z")

</div>

My incremental backup is of 2 GB and full backup is of 19 GB

---

<div class="post-metadata">

**Author:** ![matthewb](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/matthewb/32/34_2.png) [@matthewb](https://forums.percona.com/u/matthewb)\
**Post date:** [December 13, 2022, 10:04pm UTC](https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971/15 "2022-12-13T22:04:58Z")

</div>

Sounds like it’s working then. Have you monitored your CPU and disk utilization during the incremental process?

---

<div class="post-metadata">

**Author:** ![\_Sumit\_Debnath](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/_sumit_debnath/32/8589_2.png) [@\_Sumit\_Debnath](https://forums.percona.com/u/_Sumit_Debnath)\
**Post date:** [December 14, 2022, 9:12pm UTC](https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971/16 "2022-12-14T21:12:52Z")

</div>

CPU and Memory are under 30% each. I want to share the logs privately how can i do that

---

<div class="post-metadata">

**Author:** ![Ivan\_Groenewold](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/ivan_groenewold/32/6299_2.png) [@Ivan\_Groenewold](https://forums.percona.com/u/Ivan_Groenewold)\
**Post date:** [December 15, 2022, 11:26am UTC](https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971/17 "2022-12-15T11:26:02Z")

</div>

Sumit, please review my previous comment. In order for incremental backups to be fast, you need changed page tracking option which is only available in Percona Server for MySQL.

---

<div class="post-metadata">

**Author:** ![matthewb](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/matthewb/32/34_2.png) [@matthewb](https://forums.percona.com/u/matthewb)\
**Post date:** [December 15, 2022, 3:39pm UTC](https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971/18 "2022-12-15T15:39:41Z")

</div>

Are you backing up to local disk or to some mount point on a shared server?

---

<div class="post-metadata">

**Author:** ![\_Sumit\_Debnath](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/_sumit_debnath/32/8589_2.png) [@\_Sumit\_Debnath](https://forums.percona.com/u/_Sumit_Debnath)\
**Post date:** [December 16, 2022, 11:48am UTC](https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971/19 "2022-12-16T11:48:48Z")

</div>

Ok so if wana use percona server do i have to replace the existing Mysql 5.7 server.  
and if yes then how can i restore all my database and users.

---

<div class="post-metadata">

**Author:** ![Ivan\_Groenewold](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/ivan_groenewold/32/6299_2.png) [@Ivan\_Groenewold](https://forums.percona.com/u/Ivan_Groenewold)\
**Post date:** [December 16, 2022, 11:52am UTC](https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971/20 "2022-12-16T11:52:56Z")

</div>

Hi, you can simply stop the mysql server and replace the packages with Percona’s then start back. If you use the same version, then it is a drop-in replacement.

[Next page](https://forums.percona.com/t/slow-incremental-backup-mysql-5-7/18971.md?page=2)