MySQL Crashes on RHEL9 Platforms.

Description

We are observing mysql crash on RHEL 9 platforms:

2025-01-29T00:27:24Z UTC - mysqld got signal 11 ;
Most likely, you have hit a bug, but this error can also be caused by malfunctioning hardware.
BuildID[sha1]=e77b02764ef858033b5772c763304f5113262a48
Server Version: 8.0.40-31 Percona Server (GPL), Release 31, Revision 49317865

Thread pointer: 0x0
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 0 thread_stack 0x100000
/path/to/linuxgeneric/8.0.40ps/bin/mysqld(my_print_stacktrace(unsigned char const*, unsigned long)+0x41) [0x21b9a11]
/path/to/linuxgeneric/8.0.40ps/bin/mysqld(print_fatal_signal(int)+0x3e3) [0x13c62f3]
/path/to/linuxgeneric/8.0.40ps/bin/mysqld(handle_fatal_signal+0xf5) [0x13c63f5]
/lib64/libc.so.6(+0x54de0) [0x7f2a3e854de0]
/path/to/linuxgeneric/8.0.40ps/lib/plugin/component_percona_telemetry.so(+0x1d6f4) [0x7f0b7c81d6f4]
/path/to/linuxgeneric/8.0.40ps/lib/plugin/component_percona_telemetry.so(+0x1d714) [0x7f0b7c81d714]
/path/to/linuxgeneric/8.0.40ps/lib/plugin/component_percona_telemetry.so(+0x1d714) [0x7f0b7c81d714]
/path/to/linuxgeneric/8.0.40ps/lib/plugin/component_percona_telemetry.so(+0x1d714) [0x7f0b7c81d714]
/path/to/linuxgeneric/8.0.40ps/lib/plugin/component_percona_telemetry.so(+0xd186) [0x7f0b7c80d186]
/path/to/linuxgeneric/8.0.40ps/lib/plugin/component_percona_telemetry.so(+0x1fe2b) [0x7f0b7c81fe2b]
/path/to/linuxgeneric/8.0.40ps/lib/plugin/component_percona_telemetry.so(+0x20bad) [0x7f0b7c820bad]
/lib64/libstdc++.so.6(+0xd9284) [0x7f2a3ecd9284]
/lib64/libc.so.6(+0x9f832) [0x7f2a3e89f832]
/lib64/libc.so.6(+0x3f480) [0x7f2a3e83f480]
Please help us make Percona Server better by reporting any
bugs at https://bugs.percona.com/

You may download the Percona Server operations manual by visiting
http://www.percona.com/software/percona-server/. You may find information
in the manual which will help you identify the cause of the crash.
2025-01-29T00:27:27.321802Z mysqld_safe mysqld from pid file /path/to/datadir/dbname.pid ended with return value of 2

Environment

None

Activity

Show:

Chanakya Reddy February 4, 2025 at 3:34 PM

Sure thing Thank you for the help

Kamil Holubicki February 4, 2025 at 3:27 PM
Edited

We will either proceed with 2.34 or disable the component.

I recommend using 2.34. Today, it crashes here; tomorrow, it can crash somewhere else. I would say on rhel9 with 2.28 it works by chance.

Closing as ‘Not a bug’ because it happens because of the usage of not compatible glibc library version.

Chanakya Reddy February 4, 2025 at 3:20 PM

Hi

Crash happens with glibc 2.28 on rhel9 platform. 2.34 is fine. We will either proceed with 2.34 or disable the component.

Thank you

Chanakya

Kamil Holubicki February 4, 2025 at 8:23 AM

Hi , any news?

Kamil Holubicki January 31, 2025 at 7:20 PM
Edited

, thank you for the quick feedback. I understand that it failed with glibc 2.34, right? So, no hacks, and it still crashes?
I would be thankful if you could collect a core dump and other files needed for debugging as described HERE and send them to us. This will allow us to debug and fix the problem.

Once you have coredump and other files, please bundle everything in PS-9662.tar.gz file, and upload following the below steps:

To upload large files please use Percona SFTP server. Server: `sftp.percona.com` • Port: `2222` • Protocol: `sftp` • Username: PS-9662 • Password: PS-9662 • Upload via command line: `scp -P2222 ./PS-9662.tar.gz PS-9662@sftp.percona.com:PS-9662.tar.gz` • NOTES: BLIND UPLOAD ONLY service, directory listing disabled, directory mirroring disabled. Recommended clients: lftp, filezilla ADVICE: upload a tar file or similar with everything included there.

 

Please also describe steps I could reproduce the issue on my site:

  1. What OS (preferably a particular AWS AMI or something I could be sure I use exactly the same as you)

  2. What package/tarball are you using

  3. what glibc (version, exact location where I can download the same as you use)

  4. how do you start mysqld (as much details about your env as possible)

  5. my.cnf

  6. you said that you use replication. Please write as much details about your setup as possible.

Here and here you can read about telemetry.

Not a Bug

Details

Assignee

Reporter

Needs QA

Yes

Affects versions

Priority

Smart Checklist

Created January 29, 2025 at 3:50 PM
Updated February 4, 2025 at 4:38 PM
Resolved February 4, 2025 at 3:27 PM