Assertion failure: log0recv.cc:2190:!page || page_is_comp(page) == dict_table_is_comp(index->table)

Description

Initialize and start PS8.0.29 debug server with following options and enable page tracking

--log-bin=binlog --log-slave-updates --gtid-mode=ON --enforce-gtid-consistency --binlog-format=row --master_verify_checksum=ON --binlog_checksum=CRC32 --max-connections=5000 INSTALL COMPONENT 'file://component_mysqlbackup';

Run pstress with options

--tables 10 --records 200 --threads 10 --seconds 150 --no-encryption --undo-tbs-sql 0

Take full backup with page-tracking

/home/manish.chawla/pxb_8_0_30_debug/bin/xtrabackup --no-defaults --user=root --password= --backup --target-dir=/home/manish.chawla/dbbackup_10_10_2022/full -S /home/manish.chawla/PS120722_8_0_29_21_opt/socket.sock --datadir=/home/manish.chawla/PS120722_8_0_29_21_opt/data --core-file --lock-ddl --page-tracking

Take 14 incremental backups with page-tracking, example command for first incremental backup

/home/manish.chawla/pxb_8_0_30_debug/bin/xtrabackup --no-defaults --user=root --password= --backup --target-dir=/home/manish.chawla/dbbackup_10_10_2022/inc1 --incremental-basedir=/home/manish.chawla/dbbackup_10_10_2022/full -S /home/manish.chawla/PS120722_8_0_29_21_opt/socket.sock --datadir=/home/manish.chawla/PS120722_8_0_29_21_opt/data --core-file --lock-ddl --page-tracking

Prepare full backup

/home/manish.chawla/pxb_8_0_30_debug/bin/xtrabackup --no-defaults --prepare --apply-log-only --target_dir=/home/manish.chawla/dbbackup_10_10_2022/full --core-file

Prepare incremental backups 1-8

/home/manish.chawla/pxb_8_0_30_debug/bin/xtrabackup --no-defaults --prepare --apply-log-only --target_dir=/home/manish.chawla/dbbackup_10_10_2022/full --incremental-dir=/home/manish.chawla/dbbackup_10_10_2022/inc1 --core-file ... /home/manish.chawla/pxb_8_0_30_debug/bin/xtrabackup --no-defaults --prepare --apply-log-only --target_dir=/home/manish.chawla/dbbackup_10_10_2022/full --incremental-dir=/home/manish.chawla/dbbackup_10_10_2022/inc8 --core-file

PXB crashes during the prepare of the 8th incremental backup

InnoDB: Assertion failure: log0recv.cc:2190:!page || page_is_comp(page) == dict_table_is_comp(index->table) InnoDB: thread 140057707341568InnoDB: We intentionally generate a memory trap. InnoDB: Submit a detailed bug report to https://jira.percona.com/projects/PXB. InnoDB: If you get repeated assertion failures or crashes, even InnoDB: immediately after the mysqld startup, there may be InnoDB: corruption in the InnoDB tablespace. Please refer to InnoDB: http://dev.mysql.com/doc/refman/8.0/en/forcing-innodb-recovery.html InnoDB: about forcing recovery. 12:48:26 UTC - mysqld got signal 6 ; Most likely, you have hit a bug, but this error can also be caused by malfunctioning hardware. Thread pointer: 0x0 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0 thread_stack 0x100000 /home/manish.chawla/pxb_8_0_30_debug/bin/xtrabackup(my_print_stacktrace(unsigned char const*, unsigned long)+0x3d) [0x557b772d3c3d] /home/manish.chawla/pxb_8_0_30_debug/bin/xtrabackup(print_fatal_signal(int)+0x303) [0x557b7614ccc3] /home/manish.chawla/pxb_8_0_30_debug/bin/xtrabackup(handle_fatal_signal+0x65) [0x557b7614cd35] /lib/x86_64-linux-gnu/libpthread.so.0(+0x12980) [0x7f61bfeca980] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0xc7) [0x7f61bda7ee87] /lib/x86_64-linux-gnu/libc.so.6(abort+0x141) [0x7f61bda807f1] /home/manish.chawla/pxb_8_0_30_debug/bin/xtrabackup(my_abort()+0xa) [0x557b772cd37a] /home/manish.chawla/pxb_8_0_30_debug/bin/xtrabackup(ut_dbg_assertion_failed(char const*, char const*, unsigned long)+0xfe) [0x557b76658dce] /home/manish.chawla/pxb_8_0_30_debug/bin/xtrabackup(+0x183b56a) [0x557b7651d56a] /home/manish.chawla/pxb_8_0_30_debug/bin/xtrabackup(recv_recover_page_func(bool, buf_block_t*)+0x607) [0x557b765209d7] /home/manish.chawla/pxb_8_0_30_debug/bin/xtrabackup(buf_page_io_complete(buf_page_t*, bool)+0x843) [0x557b762de8c3] /home/manish.chawla/pxb_8_0_30_debug/bin/xtrabackup(fil_aio_wait(unsigned long)+0x14b) [0x557b763cb52b] /home/manish.chawla/pxb_8_0_30_debug/bin/xtrabackup(+0x19133f0) [0x557b765f53f0] /home/manish.chawla/pxb_8_0_30_debug/bin/xtrabackup(std::thread::_State_impl<std::thread::_Invoker<std::tuple<Detached_thread, void (unsigned long), unsigned long> > >::_M_run()+0xb5) [0x557b75bc7355] /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xbd6df) [0x7f61be4a46df] /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db) [0x7f61bfebf6db] /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f) [0x7f61bdb6161f]

Logs attached as pxb_logs.tar.gz

PXB compiled from https://github.com/altmannmarcelo/percona-xtrabackup/commits/PXB-2866-8.0
PXB version:

xtrabackup version 8.0.30-23 based on MySQL server 8.0.30 Linux (x86_64) (revision id: 227f5f2ef05)

Environment

None

Attachments

1
  • 13 Oct 2022, 12:26 PM

Smart Checklist

Activity

Satya Bodapati October 25, 2022 at 2:42 PM

we believe this is related to offset parsing issue https://perconadev.atlassian.net/browse/PXB-2893#icft=PXB-2893. The MLOG_INDEX_LOAD has to be parsed at redo catcup phase and this was not done properly against 8.0.29 (or lower) server

Details

Assignee

Reporter

Regression Issue

Yes

Found by Automation

Yes

Needs QA

Yes

Time tracking

1h logged

Affects versions

Priority

Smart Checklist

Created October 13, 2022 at 12:32 PM
Updated March 6, 2024 at 6:18 PM

Flag notifications