wsrep_recovery log is missing after pod restart

Description

After my PXC got stuck in the bug:

https://jira.percona.com/browse/PXC-3432

I killed pod-0

as

kubectl delete pods cluster1-pxc-0 --grace-period=0 --force

and I hoped it would restart,

however it ended up in CrashLoopBackOff loop

the log is:

 

Unfortunately the file wsrep_recovery_verbose.log is not accessible, as the pod was already killed.

I suggest we redirect the log to some accessible location

 

Environment

None

Smart Checklist

Activity

Slava Sarzhan October 12, 2020 at 8:38 AM

Hi,

We have improved such behaviour. Now we print content of 'wsrep_recovery_verbose.log' before cleaning it up. So, you can see the log from the previous start. Also we have "$DATADIR/wsrep_recovery_verbose_history.log" which contains history of all previous recovery logs.
 

Vadim Tkachenko September 24, 2020 at 3:52 PM

Because I can get access to PC with log file, I can read it:

 

 

 

So it seems to be PS/PXC bug. For operator we will need to get log more accessible

 

 

Done

Details

Assignee

Reporter

Time tracking

2h logged

Fix versions

Priority

Smart Checklist

Created September 24, 2020 at 3:50 PM
Updated March 5, 2024 at 6:06 PM
Resolved February 2, 2021 at 3:49 PM