Skip to:

  1. Skip to Jira Navigation
  2. Skip to Side Navigation
  3. Skip to Main Content

Error in `/usr/sbin/mysqld': free(): invalid pointer: 0x00007f55acf52500

Description

Crashed 2 out of 3 galera nodes. Seen multiple times past week. Running on Debian Stretch 4.9.168-1+deb9u4, Galera 3.37(rff05089), /usr/sbin/mysqld (mysqld 5.7.26-29-57).

mysql error log:
2019-09-02T10:06:09.140007Z 0 [Note] WSREP: Created page /srv/data/mysql2/gcache.page.000000 of size 134217728 bytes
*** Error in `/usr/sbin/mysqld': free(): invalid pointer: 0x00007f55acf52500 ***
======= Backtrace: =========
/lib/x86_64-linux-gnu/libc.so.6(+0x70bfb)[0x7f55bde4cbfb]
/lib/x86_64-linux-gnu/libc.so.6(+0x76fc6)[0x7f55bde52fc6]
/lib/x86_64-linux-gnu/libc.so.6(+0x7780e)[0x7f55bde5380e]
/usr/lib/galera3/libgalera_smm.so(_ZN6gcache6GCache11free_commonEPNS_12BufferHeaderE+0xcb)[0x7f55b502fd2b]
/usr/lib/galera3/libgalera_smm.so(_ZN6gcache6GCache13seqno_releaseEl+0x1e2)[0x7f55b500dcf2]
/usr/lib/galera3/libgalera_smm.so(_ZN6galera10ServiceThd8thd_funcEPv+0x167)[0x7f55b5148e07]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x74a4)[0x7f55c01a14a4]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x7f55bdec4d0f]
======= Memory map: ========
55bfad215000-55bfaea81000 r-xp 00000000 08:01 18964 /usr/sbin/mysqld
55bfaec80000-55bfaed62000 r--p 0186b000 08:01 18964 /usr/sbin/mysqld
55bfaed62000-55bfaee12000 rw-p 0194d000 08:01 18964 /usr/sbin/mysqld
{{55bfaee12000-55bfaeef9000 rw-p 00000000 00:00 0 }}
55bfaf8e0000-55bfb07ef000 rw-p 00000000 00:00 0 [heap]
7f53dc000000-7f53e4000000 rw-s 00000000 08:10 2359952 /srv/data/mysql2/gcache.page.000000
{{7f53e4000000-7f53e45a4000 rw-p 00000000 00:00 0 }}
{{7f53e45a4000-7f53e8000000 ---p 00000000 00:00 0 }}
{{7f53ec000000-7f53ec021000 rw-p 00000000 00:00 0 }}
{{7f53ec021000-7f53f0000000 ---p 00000000 00:00 0 }}
{{7f53f0000000-7f53f0021000 rw-p 00000000 00:00 0 }}
{{7f53f0021000-7f53f4000000 ---p 00000000 00:00 0 }}
{{7f53f4000000-7f53f4021000 rw-p 00000000 00:00 0 }}
{{7f53f4021000-7f53f8000000 ---p 00000000 00:00 0 }}
{{7f53f8000000-7f53f8021000 rw-p 00000000 00:00 0 }}
{{7f53f8021000-7f53fc000000 ---p 00000000 00:00 0 }}
{{7f53fc000000-7f53fdf7c000 rw-p 00000000 00:00 0 }}
{{7f53fdf7c000-7f5400000000 ---p 00000000 00:00 0 }}
{{7f5400000000-7f54016f4000 rw-p 00000000 00:00 0 }}
{{7f54016f4000-7f5404000000 ---p 00000000 00:00 0 }}
{{7f5404000000-7f5404c24000 rw-p 00000000 00:00 0 }}
{{7f5404c24000-7f5408000000 ---p 00000000 00:00 0 }}
{{7f5408000000-7f5408f64000 rw-p 00000000 00:00 0 }}
{{7f5408f64000-7f540c000000 ---p 00000000 00:00 0 }}
{{7f540fef8000-7f540fef9000 ---p 00000000 00:00 0 }}
{{7f540fef9000-7f540ff3a000 rw-p 00000000 00:00 0 }}
{{7f540ff3a000-7f540ff3b000 ---p 00000000 00:00 0 }}
{{7f540ff3b000-7f540ff7c000 rw-p 00000000 00:00 0 }}
{{7f540ff7c000-7f540ff7d000 ---p 00000000 00:00 0 }}
{{7f540ff7d000-7f540ffbe000 rw-p 00000000 00:00 0 }}
{{7f540ffbe000-7f540ffbf000 ---p 00000000 00:00 0 }}
{{7f540ffbf000-7f5410000000 rw-p 00000000 00:00 0 }}
{{7f5410000000-7f5410021000 rw-p 00000000 00:00 0 }}
{{7f5410021000-7f5414000000 ---p 00000000 00:00 0 }}
{{7f5414000000-7f5414305000 rw-p 00000000 00:00 0 }}
{{7f5414305000-7f5418000000 ---p 00000000 00:00 0 }}
{{7f5418000000-7f5418021000 rw-p 00000000 00:00 0 }}
{{7f5418021000-7f541c000000 ---p 00000000 00:00 0 }}
{{7f541c000000-7f541c021000 rw-p 00000000 00:00 0 }}
{{7f541c021000-7f5420000000 ---p 00000000 00:00 0 }}
{{7f5420000000-7f5421c18000 rw-p 00000000 00:00 0 }}
{{7f5421c18000-7f5424000000 ---p 00000000 00:00 0 }}
{{7f5424000000-7f542561c000 rw-p 00000000 00:00 0 }}
{{7f542561c000-7f5428000000 ---p 00000000 00:00 0 }}
{{7f5428000000-7f5428021000 rw-p 00000000 00:00 0 }}
{{7f5428021000-7f542c000000 ---p 00000000 00:00 0 }}
{{7f542c000000-7f542c132000 rw-p 00000000 00:00 0 }}
{{7f542c132000-7f5430000000 ---p 00000000 00:00 0 }}
{{7f5430000000-7f54300ae000 rw-p 00000000 00:00 0 }}
{{7f54300ae000-7f5434000000 ---p 00000000 00:00 0 }}
{{7f5434000000-7f5434083000 rw-p 00000000 00:00 0 }}
{{7f5434083000-7f5438000000 ---p 00000000 00:00 0 }}
{{7f5438000000-7f54380b0000 rw-p 00000000 00:00 0 }}
{{7f54380b0000-7f543c000000 ---p 00000000 00:00 0 }}
{{7f543c000000-7f543c0b0000 rw-p 00000000 00:00 0 }}
{{7f543c0b0000-7f5440000000 ---p 00000000 00:00 0 }}
{{7f5440000000-7f544013f000 rw-p 00000000 00:00 0 }}
{{7f544013f000-7f5444000000 ---p 00000000 00:00 0 }}
{{7f5444035000-7f5444036000 ---p 00000000 00:00 0 }}
{{7f5444036000-7f5444077000 rw-p 00000000 00:00 0 }}
{{7f5444077000-7f5444078000 ---p 00000000 00:00 0 }}
{{7f5444078000-7f54440b9000 rw-p 00000000 00:00 0 }}
{{7f54440b9000-7f54440ba000 ---p 00000000 00:00 0 }}
{{7f54440ba000-7f5444f7c000 rw-p 00000000 00:00 0 }}
{{7f5444f7c000-7f5444f7d000 ---p 00000000 00:00 0 }}
{{7f5444f7d000-7f544577d000 rw-p 00000000 00:00 0 }}
{{7f544577d000-7f544577e000 ---p 00000000 00:00 0 }}
{{7f544577e000-7f5448878000 rw-p 00000000 00:00 0 }}
{{7f5448878000-7f5448879000 ---p 00000000 00:00 0 }}
{{7f5448879000-7f544927e000 rw-p 00000000 00:00 0 }}
{{7f544927e000-7f544927f000 ---p 00000000 00:00 0 }}
{{7f544927f000-7f5449a7f000 rw-p 00000000 00:00 0 }}
{{7f5449a7f000-7f5449a80000 ---p 00000000 00:00 0 }}
{{7f5449a80000-7f544a280000 rw-p 00000000 00:00 0 }}
{{7f544a280000-7f544a281000 ---p 00000000 00:00 0 }}
{{7f544a281000-7f544aa81000 rw-p 00000000 00:00 0 }}
{{7f544aa81000-7f544aa82000 ---p 00000000 00:00 0 }}
{{7f544aa82000-7f544b282000 rw-p 00000000 00:00 0 }}
{{7f544b282000-7f544b283000 ---p 00000000 00:00 0 }}
{{7f544b283000-7f544ba83000 rw-p 00000000 00:00 0 }}
{{7f544ba83000-7f544ba84000 ---p 00000000 00:00 0 }}
{{7f544ba84000-7f544c284000 rw-p 00000000 00:00 0 }}
{{7f544c284000-7f544c285000 ---p 00000000 00:00 0 }}
{{7f544c285000-7f544ca85000 rw-p 00000000 00:00 0 }}
{{7f544ca85000-7f544ca86000 ---p 00000000 00:00 0 }}
{{7f544ca86000-7f544d286000 rw-p 00000000 00:00 0 }}
{{7f544d286000-7f544d287000 ---p 00000000 00:00 0 }}
{{7f544d287000-7f544da87000 rw-p 00000000 00:00 0 }}
{{7f544da87000-7f544da88000 ---p 00000000 00:00 0 }}
{{7f544da88000-7f544e288000 rw-p 00000000 00:00 0 }}
{{7f544e288000-7f544e289000 ---p 00000000 00:00 0 }}
{{7f544e289000-7f544ea89000 rw-p 00000000 00:00 0 }}
{{7f544ea89000-7f544ea8a000 ---p 00000000 00:00 0 }}
{{7f544ea8a000-7f544f28a000 rw-p 00000000 00:00 0 }}
{{7f544f28a000-7f544f28b000 ---p 00000000 00:00 0 }}
{{7f544f28b000-7f544fa8b000 rw-p 00000000 00:00 0 }}
{{7f544fa8b000-7f544fa8c000 ---p 00000000 00:00 0 }}
{{7f544fa8c000-7f545028c000 rw-p 00000000 00:00 0 }}
{{7f545028c000-7f545028d000 ---p 00000000 00:00 0 }}
{{7f545028d000-7f5450a8d000 rw-p 00000000 00:00 0 }}
{{7f5450a8d000-7f5450a8e000 ---p 00000000 00:00 0 }}
{{7f5450a8e000-7f545128e000 rw-p 00000000 00:00 0 }}
{{7f545128e000-7f545128f000 ---p 00000000 00:00 0 }}
{{7f545128f000-7f5451a8f000 rw-p 00000000 00:00 0 }}
{{7f5451a8f000-7f5451a90000 ---p 00000000 00:00 0 }}
{{7f5451a90000-7f5452290000 rw-p 00000000 00:00 0 }}
{{7f5452290000-7f5452291000 ---p 00000000 00:00 0 }}
{{7f5452291000-7f5454cc6000 rw-p 00000000 00:00 0 }}
{{7f5454ce9000-7f5454cea000 ---p 00000000 00:00 0 }}
{{7f5454cea000-7f5454d2b000 rw-p 00000000 00:00 0 }}
{{7f5454d2b000-7f5454d2c000 ---p 00000000 00:00 0 }}
{{7f5454d2c000-7f5454d6d000 rw-p 00000000 00:00 0 }}
{{7f5454d6d000-7f5454d6e000 ---p 00000000 00:00 0 }}
{{7f5454d6e000-7f5454daf000 rw-p 00000000 00:00 0 }}
7f5454daf000-7f5454db0000 r-xp 00000000 08:01 393488 /usr/lib/mysql/plugin/auth_socket.so
7f5454db0000-7f5454faf000 ---p 00001000 08:01 393488 /usr/lib/mysql/plugin/auth_socket.so
7f5454faf000-7f5454fb0000 r--p 00000000 08:01 393488 /usr/lib/mysql/plugin/auth_socket.so
7f5454fb0000-7f5454fb1000 rw-p 00001000 08:01 393488 /usr/lib/mysql/plugin/auth_socket.so
{{7f5454fb1000-7f5454fb2000 ---p 00000000 00:00 0 }}
{{7f5454fb2000-7f54557b2000 rw-p 00000000 00:00 0 }}
{{7f54557b2000-7f54557b3000 ---p 00000000 00:00 0 }}
{{7f54557b3000-7f5455fb3000 rw-p 00000000 00:00 0 }}
{{7f5455fb3000-7f5455fb4000 ---p 00000000 00:00 0 }}
{{7f5455fb4000-7f54567b4000 rw-p 00000000 00:00 0 }}
{{7f54567b4000-7f54567b5000 ---p 00000000 00:00 0 }}
{{7f54567b5000-7f5456fb5000 rw-p 00000000 00:00 0 }}
{{7f5456fb5000-7f5456fb6000 ---p 00000000 00:00 0 }}
{{7f5456fb6000-7f54577b6000 rw-p 00000000 00:00 0 }}
{{7f54577b6000-7f54577b7000 ---p 00000000 00:00 0 }}
{{7f54577b7000-7f5457fb7000 rw-p 00000000 00:00 0 }}
{{7f5457fb7000-7f5457fb8000 ---p 00000000 00:00 0 }}
{{7f5457fb8000-7f54587b8000 rw-p 00000000 00:00 0 }}
{{7f54587b8000-7f54587b9000 ---p 00000000 00:00 0 }}
{{7f54587b9000-7f5458fb9000 rw-p 00000000 00:00 0 }}
{{7f5458fb9000-7f5458fba000 ---p 00000000 00:00 0 }}
{{7f5458fba000-7f546023d000 rw-p 00000000 00:00 0 }}
{{7f546023d000-7f54921bd000 rw-p 00000000 00:00 0 }}
{{7f54921bd000-7f5492280000 rw-p 00000000 00:00 0 }}
{{7f5492280000-7f558c000000 rw-p 00000000 00:00 0 }}
{{7f558c000000-7f558c021000 rw-p 00000000 00:00 0 }}
{{7f558c021000-7f5590000000 ---p 00000000 00:00 0 }}
{{7f5590000000-7f5590021000 rw-p 00000000 00:00 0 }}
{{7f5590021000-7f5594000000 ---p 00000000 00:00 0 }}
{{7f5594000000-7f5594a69000 rw-p 00000000 00:00 0 }}
{{7f5594a69000-7f5598000000 ---p 00000000 00:00 0 }}
{{7f5598000000-7f5598021000 rw-p 00000000 00:00 0 }}
{{7f5598021000-7f559c000000 ---p 00000000 00:00 0 }}
{{7f559c000000-7f559c03a000 rw-p 00000000 00:00 0 }}
{{7f559c03a000-7f55a0000000 ---p 00000000 00:00 0 }}
{{7f55a0000000-7f55a0025000 rw-p 00000000 00:00 0 }}
{{7f55a0025000-7f55a4000000 ---p 00000000 00:00 0 }}
{{7f55a4000000-7f55a4021000 rw-p 00000000 00:00 0 }}
{{7f55a4021000-7f55a8000000 ---p 00000000 00:00 0 }}
{{7f55a8014000-7f55a8015000 ---p 00000000 00:00 0 }}
{{7f55a8015000-7f55a881a000 rw-p 00000000 00:00 0 }}
7f55a881a000-7f55a881f000 rw-s 00000000 00:0e 7993945 /[aio] (deleted)
7f55a881f000-7f55a8824000 rw-s 00000000 00:0e 7993944 /[aio] (deleted)
7f55a8824000-7f55a8829000 rw-s 00000000 00:0e 7993943 /[aio] (deleted)
7f55a8829000-7f55a882e000 rw-s 00000000 00:0e 7993942 /[aio] (deleted)
{{7f55a882e000-7f55a8881000 rw-p 00000000 00:00 0 }}
7f55a8881000-7f55a8886000 rw-s 00000000 00:0e 7993941 /[aio] (deleted)
7f55a8886000-7f55a888b000 rw-s 00000000 00:0e 7993940 /[aio] (deleted)
7f55a888b000-7f55a8890000 rw-s 00000000 00:0e 7993939 /[aio] (deleted)
7f55a8890000-7f55a8895000 rw-s 00000000 00:0e 7993938 /[aio] (deleted)
7f55a8895000-7f55a889a000 rw-s 00000000 00:0e 7993937 /[aio] (deleted)
7f55a889a000-7f55a889f000 rw-s 00000000 00:0e 7993936 /[aio] (deleted)
{{7f55a889f000-7f55a8d15000 rw-p 00000000 00:00 0 }}
{{7f55a8d15000-7f55a8d16000 ---p 00000000 00:00 0 }}
{{7f55a8d16000-7f55a9516000 rw-p 00000000 00:00 0 }}
{{7f55a9516000-7f55a9517000 ---p 00000000 00:00 0 }}
{{7f55a9517000-7f55a9d17000 rw-p 00000000 00:00 0 }}
{{7f55a9d50000-7f55a9d51000 ---p 00000000 00:00 0 }}
{{7f55a9d51000-7f55a9d92000 rw-p 00000000 00:00 0 }}
{{7f55a9d92000-7f55a9d93000 ---p 00000000 00:00 0 }}
{{7f55a9d93000-7f55a9dd4000 rw-p 00000000 00:00 0 }}
{{7f55a9dd4000-7f55a9dd5000 ---p 00000000 00:00 0 }}
{{7f55a9dd5000-7f55aa5d5000 rw-p 00000000 00:00 0 }}
7f55aa5d5000-7f55aa60a000 r--s 00000000 08:01 274395 /var/cache/nscd/hosts
{{7f55aa60a000-7f55aa60b000 ---p 00000000 00:00 0 }}
{{7f55aa60b000-7f55ac60e000 rw-p 00000000 00:00 0 }}
{{7f55ac60e000-7f55ac60f000 ---p 00000000 00:00 0 }}
{{7f55ac60f000-7f55acf52000 rw-p 00000000 00:00 0 }}
7f55acf52000-7f55b4f53000 rw-s 00000000 08:10 2359302 /srv/data/mysql2/galera.cache
7f55b4f53000-7f55b51f5000 r-xp 00000000 08:01 393480 /usr/lib/galera3/libgalera_smm.so
7f55b51f5000-7f55b53f4000 ---p 002a2000 08:01 393480 /usr/lib/galera3/libgalera_smm.so
7f55b53f4000-7f55b53fa000 r--p 002a1000 08:01 393480 /usr/lib/galera3/libgalera_smm.so
7f55b53fa000-7f55b53fc000 rw-p 002a7000 08:01 393480 /usr/lib/galera3/libgalera_smm.so
{{7f55b53fc000-7f55b53ff000 rw-p 00000000 00:00 0 }}
{{7f55b53ff000-7f55b5400000 ---p 00000000 00:00 0 }}
{{7f55b5400000-7f55b5c00000 rw-p 00000000 00:00 0 }}
7f55b5c00000-7f55b5c35000 r--s 00000000 08:01 274394 /var/cache/nscd/group
7f55b5c35000-7f55b5c6a000 r--s 00000000 08:01 274393 /var/cache/nscd/passwd
{{7f55b5c6a000-7f55bdbc4000 rw-p 00000000 00:00 0 }}
7f55bdbc4000-7f55bdbd8000 r-xp 00000000 08:01 131689 /lib/x86_64-linux-gnu/libnsl-2.24.so
7f55bdbd8000-7f55bddd8000 ---p 00014000 08:01 131689 /lib/x86_64-linux-gnu/libnsl-2.24.so
7f55bddd8000-7f55bddd9000 r--p 00014000 08:01 131689 /lib/x86_64-linux-gnu/libnsl-2.24.so
7f55bddd9000-7f55bddda000 rw-p 00015000 08:01 131689 /lib/x86_64-linux-gnu/libnsl-2.24.so
{{7f55bddda000-7f55bdddc000 rw-p 00000000 00:00 0 }}
7f55bdddc000-7f55bdf71000 r-xp 00000000 08:01 131682 /lib/x86_64-linux-gnu/libc-2.24.so
7f55bdf71000-7f55be171000 ---p 00195000 08:01 131682 /lib/x86_64-linux-gnu/libc-2.24.so
7f55be171000-7f55be175000 r--p 00195000 08:01 131682 /lib/x86_64-linux-gnu/libc-2.24.so
7f55be175000-7f55be177000 rw-p 00199000 08:01 131682 /lib/x86_64-linux-gnu/libc-2.24.so
{{7f55be177000-7f55be17b000 rw-p 00000000 00:00 0 }}
7f55be17b000-7f55be191000 r-xp 00000000 08:01 131088 /lib/x86_64-linux-gnu/libgcc_s.so.1
7f55be191000-7f55be390000 ---p 00016000 08:01 131088 /lib/x86_64-linux-gnu/libgcc_s.so.1
7f55be390000-7f55be391000 r--p 00015000 08:01 131088 /lib/x86_64-linux-gnu/libgcc_s.so.1
7f55be391000-7f55be392000 rw-p 00016000 08:01 131088 /lib/x86_64-linux-gnu/libgcc_s.so.1
7f55be392000-7f55be495000 r-xp 00000000 08:01 131686 /lib/x86_64-linux-gnu/libm-2.24.so
7f55be495000-7f55be694000 ---p 00103000 08:01 131686 /lib/x86_64-linux-gnu/libm-2.24.so
7f55be694000-7f55be695000 r--p 00102000 08:01 131686 /lib/x86_64-linux-gnu/libm-2.24.so
7f55be695000-7f55be696000 rw-p 00103000 08:01 131686 /lib/x86_64-linux-gnu/libm-2.24.so
7f55be696000-7f55be808000 r-xp 00000000 08:01 6432 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.22
7f55be808000-7f55bea08000 ---p 00172000 08:01 6432 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.22
7f55bea08000-7f55bea12000 r--p 00172000 08:01 6432 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.22
7f55bea12000-7f55bea14000 rw-p 0017c000 08:01 6432 /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.22
{{7f55bea14000-7f55bea18000 rw-p 00000000 00:00 0 }}
7f55bea18000-7f55bea1e000 r-xp 00000000 08:01 18654 /usr/lib/x86_64-linux-gnu/libatomic.so.1.2.0
7f55bea1e000-7f55bec1d000 ---p 00006000 08:01 18654 /usr/lib/x86_64-linux-gnu/libatomic.so.1.2.0
7f55bec1d000-7f55bec1e000 r--p 00005000 08:01 18654 /usr/lib/x86_64-linux-gnu/libatomic.so.1.2.0
7f55bec1e000-7f55bec1f000 rw-p 00006000 08:01 18654 /usr/lib/x86_64-linux-gnu/libatomic.so.1.2.0
{{7f55bec1f000-7f55bec20000 rw-p 00000000 00:00 0 }}
7f55bec20000-7f55bec27000 r-xp 00000000 08:01 131699 /lib/x86_64-linux-gnu/librt-2.24.so
7f55bec27000-7f55bee26000 ---p 00007000 08:01 131699 /lib/x86_64-linux-gnu/librt-2.24.so
7f55bee26000-7f55bee27000 r--p 00006000 08:01 131699 /lib/x86_64-linux-gnu/librt-2.24.so
7f55bee27000-7f55bee28000 rw-p 00007000 08:01 131699 /lib/x86_64-linux-gnu/librt-2.24.so
7f55bee28000-7f55bee41000 r-xp 00000000 08:01 131281 /lib/x86_64-linux-gnu/libz.so.1.2.8
7f55bee41000-7f55bf040000 ---p 00019000 08:01 131281 /lib/x86_64-linux-gnu/libz.so.1.2.8
7f55bf040000-7f55bf041000 r--p 00018000 08:01 131281 /lib/x86_64-linux-gnu/libz.so.1.2.8
7f55bf041000-7f55bf042000 rw-p 00019000 08:01 131281 /lib/x86_64-linux-gnu/libz.so.1.2.8
7f55bf042000-7f55bf045000 r-xp 00000000 08:01 131685 /lib/x86_64-linux-gnu/libdl-2.24.so
7f55bf045000-7f55bf244000 ---p 00003000 08:01 131685 /lib/x86_64-linux-gnu/libdl-2.24.so
7f55bf244000-7f55bf245000 r--p 00002000 08:01 131685 /lib/x86_64-linux-gnu/libdl-2.24.so
7f55bf245000-7f55bf246000 rw-p 00003000 08:01 131685 /lib/x86_64-linux-gnu/libdl-2.24.so
7f55bf246000-7f55bf4b0000 r-xp 00000000 08:01 1815 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1
7f55bf4b0000-7f55bf6b0000 ---p 0026a000 08:01 1815 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1
7f55bf6b0000-7f55bf6ce000 r--p 0026a000 08:01 1815 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1
7f55bf6ce000-7f55bf6dc000 rw-p 00288000 08:01 1815 /usr/lib/x86_64-linux-gnu/libcrypto.so.1.1
{{7f55bf6dc000-7f55bf6df000 rw-p 00000000 00:00 0 }}
7f55bf6df000-7f55bf742000 r-xp 00000000 08:01 1847 /usr/lib/x86_64-linux-gnu/libssl.so.1.1
7f55bf742000-7f55bf941000 ---p 00063000 08:01 1847 /usr/lib/x86_64-linux-gnu/libssl.so.1.1
7f55bf941000-7f55bf945000 r--p 00062000 08:01 1847 /usr/lib/x86_64-linux-gnu/libssl.so.1.1
7f55bf945000-7f55bf94b000 rw-p 00066000 08:01 1847 /usr/lib/x86_64-linux-gnu/libssl.so.1.1
7f55bf94b000-7f55bf953000 r-xp 00000000 08:01 131684 /lib/x86_64-linux-gnu/libcrypt-2.24.so
7f55bf953000-7f55bfb53000 ---p 00008000 08:01 131684 /lib/x86_64-linux-gnu/libcrypt-2.24.so
7f55bfb53000-7f55bfb54000 r--p 00008000 08:01 131684 /lib/x86_64-linux-gnu/libcrypt-2.24.so
7f55bfb54000-7f55bfb55000 rw-p 00009000 08:01 131684 /lib/x86_64-linux-gnu/libcrypt-2.24.so
{{7f55bfb55000-7f55bfb83000 rw-p 00000000 00:00 0 }}
7f55bfb83000-7f55bfb8b000 r-xp 00000000 08:01 133077 /lib/x86_64-linux-gnu/libwrap.so.0.7.6
7f55bfb8b000-7f55bfd8b000 ---p 00008000 08:01 133077 /lib/x86_64-linux-gnu/libwrap.so.0.7.6
7f55bfd8b000-7f55bfd8c000 r--p 00008000 08:01 133077 /lib/x86_64-linux-gnu/libwrap.so.0.7.6
7f55bfd8c000-7f55bfd8d000 rw-p 00009000 08:01 133077 /lib/x86_64-linux-gnu/libwrap.so.0.7.6
7f55bfd8d000-7f55bfd97000 r-xp 00000000 08:01 3319 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0
7f55bfd97000-7f55bff96000 ---p 0000a000 08:01 3319 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0
7f55bff96000-7f55bff97000 r--p 00009000 08:01 3319 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0
7f55bff97000-7f55bff98000 rw-p 0000a000 08:01 3319 /usr/lib/x86_64-linux-gnu/libnuma.so.1.0.0
7f55bff98000-7f55bff99000 r-xp 00000000 08:01 135438 /lib/x86_64-linux-gnu/libaio.so.1.0.1
7f55bff99000-7f55c0198000 ---p 00001000 08:01 135438 /lib/x86_64-linux-gnu/libaio.so.1.0.1
7f55c0198000-7f55c0199000 r--p 00000000 08:01 135438 /lib/x86_64-linux-gnu/libaio.so.1.0.1
{{7f55c0199000-7f55c019a000 rw-p 00000000 00:00 0 }}
7f55c019a000-7f55c01b2000 r-xp 00000000 08:01 131697 /lib/x86_64-linux-gnu/libpthread-2.24.so
7f55c01b2000-7f55c03b1000 ---p 00018000 08:01 131697 /lib/x86_64-linux-gnu/libpthread-2.24.so
7f55c03b1000-7f55c03b2000 r--p 00017000 08:01 131697 /lib/x86_64-linux-gnu/libpthread-2.24.so
7f55c03b2000-7f55c03b3000 rw-p 00018000 08:01 131697 /lib/x86_64-linux-gnu/libpthread-2.24.so
{{7f55c03b3000-7f55c03b7000 rw-p 00000000 00:00 0 }}
7f55c03b7000-7f55c03da000 r-xp 00000000 08:01 131490 /lib/x86_64-linux-gnu/ld-2.24.so
{{7f55c03db000-7f55c05d5000 rw-p 00000000 00:00 0 }}
{{7f55c05d6000-7f55c05d7000 rw-p 00000000 00:00 0 }}
7f55c05d7000-7f55c05d9000 rw-s 00000000 00:0e 7993946 /[aio] (deleted)
7f55c05d9000-7f55c05da000 rw-s 00000000 00:0e 7993935 /[aio] (deleted)
7f55c05da000-7f55c05db000 r--p 00023000 08:01 131490 /lib/x86_64-linux-gnu/ld-2.24.so
7f55c05db000-7f55c05dc000 rw-p 00024000 08:01 131490 /lib/x86_64-linux-gnu/ld-2.24.so
{{7f55c05dc000-7f55c05dd000 rw-p 00000000 00:00 0 }}
7fff81bfc000-7fff81c22000 rw-p 00000000 00:00 0 [stack]
7fff81dd5000-7fff81dd7000 r--p 00000000 00:00 0 [vvar]
7fff81dd7000-7fff81dd9000 r-xp 00000000 00:00 0 [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall]
10:06:09 UTC - mysqld got signal 6 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
Attempting to collect some information that could help diagnose the problem.
As this is a crash and something is definitely wrong, the information
collection process might fail.
Please help us make Percona XtraDB Cluster better by reporting any
bugs at [https://jira.percona.com/projects/PXC/issues]

key_buffer_size=65536
read_buffer_size=131072
max_used_connections=9
max_threads=152
thread_count=10
connection_count=8
{{It is possible that mysqld could use up to }}
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 60284 K bytes of memory
Hope that's ok; if not, decrease some variables in the equation.

Thread pointer: 0x0
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 0 thread_stack 0x40000
/usr/sbin/mysqld(my_print_stacktrace+0x2c)[0x55bfadf8b27c]
/usr/sbin/mysqld(handle_fatal_signal+0x489)[0x55bfad86e1b9]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x110e0)[0x7f55c01ab0e0]
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0xcf)[0x7f55bde0efff]
/lib/x86_64-linux-gnu/libc.so.6(abort+0x16a)[0x7f55bde1042a]
/lib/x86_64-linux-gnu/libc.so.6(+0x70c00)[0x7f55bde4cc00]
/lib/x86_64-linux-gnu/libc.so.6(+0x76fc6)[0x7f55bde52fc6]
/lib/x86_64-linux-gnu/libc.so.6(+0x7780e)[0x7f55bde5380e]
/usr/lib/galera3/libgalera_smm.so(_ZN6gcache6GCache11free_commonEPNS_12BufferHeaderE+0xcb)[0x7f55b502fd2b]
/usr/lib/galera3/libgalera_smm.so(_ZN6gcache6GCache13seqno_releaseEl+0x1e2)[0x7f55b500dcf2]
/usr/lib/galera3/libgalera_smm.so(_ZN6galera10ServiceThd8thd_funcEPv+0x167)[0x7f55b5148e07]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x74a4)[0x7f55c01a14a4]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x7f55bdec4d0f]
You may download the Percona XtraDB Cluster operations manual by visiting
[http://www.percona.com/software/percona-xtradb-cluster/]. You may find information
in the manual which will help you identify the cause of the crash.

Environment

None

Attachments

5

Smart Checklist

Activity

Show:

Jira Bot September 25, 2020 at 4:24 PM

Hello ,
It's been 58 days since this issue went into Incomplete and we haven't heard
from you on this.

At this point, our policy is to Close this issue, to keep things from getting
too cluttered. If you have more information about this issue and wish to
reopen it, please reply with a comment containing "jira-bot=reopen".

Jira Bot September 11, 2020 at 8:56 AM

Hello ,
It's jira-bot again. Your bug report is important to us, but we haven't heard
from you since the previous notification. If we don't hear from you on
this in 7 days, the issue will be automatically closed.

Jira Bot August 27, 2020 at 7:56 AM

Hello ,
I'm jira-bot, Percona's automated helper script. Your bug report is important
to us but we've been unable to reproduce it, and asked you for more
information. If we haven't heard from you on this in 3 more weeks, the issue
will be automatically closed.

Lalit Choudhary July 29, 2020 at 7:29 AM

Hi Joep,

Thank you for the update. 

https://github.com/codership/galera/issues/419  as per the github report following was the cause for the crash,

 

Can please try this.

 

 

Joep Seuren July 28, 2020 at 12:14 PM

Hi,

I've located the issue... it's exactly the same as https://github.com/codership/galera/issues/419.

When updating the node, i usually start the instances with `mysqld_multi start 0-20`. After that, when everything seems OK, i (somehow) decided that the best action is running `systemctl start percona@$instance_id`. This custom systemd service apperently does not check if the current proces is running, so I need to fix that...

 

 

Incomplete

Details

Assignee

Reporter

Labels

Affects versions

Priority

Smart Checklist

Created September 4, 2019 at 2:07 PM
Updated March 6, 2024 at 10:05 PM
Resolved September 25, 2020 at 4:24 PM
Configure