Evaluate use of pagetracking for full backup.

Description

PXB copies all redo logs from the start of the backup and until the end. and If the Server is under stress the size of the redo logs could be huge.
This lead to
1) copy of the huge redo log file.
2) Prepare of backup would take additional time to apply changes from redo logs.

We can evaluate the use of pagetracking for a full backup similar to what a clone does. 

Instead of copying the redo log from the start of the backup. We can  rely on pagetracking to give us modified pages. 

  1. start page tracking

  2. copy data files

  3. start redo copy thread

  4. Get list of pages from start of page-tracking to step 3 (redo copy thread start)

  5. copy modified pages given by above list

  6. stop copy thread

This can help us to avoid the copy of redo for the data copy stage which is the longest stage of backup.

 

Environment

None

Smart Checklist

Activity

Show:

Jan Mynar February 19, 2025 at 12:48 PM

not a priority for now

Rahul Malik March 31, 2023 at 5:41 AM
Edited

Design document Google doc

Satya Bodapati October 25, 2022 at 11:22 AM
Edited

There is redo catch up phase in PXB is there two handle two issues

  1. to handle encrypted tablespaces that don thave encryption information on page 0

  2. to handle tablespaces that  finished bulk load (wihtout redo) MLOG_INDEX_LOAD

 

We have to address these design issues

Rahul Malik October 25, 2022 at 11:12 AM
Edited

To answer the question How much it would improve the time/size of the backup? 

We can evaluate the performance of clone and PXB under the stress. 

Without the load both Clone and PXB will just copy the ibd files. So the performance should be similar, This is even shown in the [benchmark |https://www.percona.com/blog/2021/01/19/the-mysql-clone-wars-plugin-vs-percona-xtrabackup/]. 

Under stress, clone uses the page tracking and redo and PXB uses only redo the log files to find file changes after the start of the process.

So our first step is to evaluate the performance under the load. If Clone has the advantage over PXB, It could be worth doing POC. 

Won't Do

Details

Assignee

Reporter

Needs QA

Yes

Affects versions

Priority

Smart Checklist

Created October 25, 2022 at 11:00 AM
Updated February 19, 2025 at 12:48 PM
Resolved February 19, 2025 at 12:48 PM