replica cluster (cross-site) doesn't work with proxysql
Description
Environment
Attachments
is blocked by
relates to
Smart Checklist
Activity

Pavel Tankov January 25, 2024 at 7:15 PM
I am receiving the same errors in the operator log as in the description of this bug:
plus, the replication does not happen.
what I did was:
setup replication with haproxy
make sure it works
just change
proxysql
-> enabled andhaproxy
-> disabledsetup replication again
it doesn't work

natalia.marukovich December 6, 2022 at 6:08 PM
Using haproxy:

natalia.marukovich December 6, 2022 at 4:17 PM
For replica in pxc-monit logs I see:
But

natalia.marukovich December 6, 2022 at 4:07 PMEdited
Replica cluster:
Operator log:
Both clusters in READY state
Replica status:
But data replicate from source cluster to the replica one.
Connect to proxysql in replica NS and can see all the data:

Tomislav Plavcic May 31, 2022 at 3:58 PMEdited
I was checking this change in proxysql-admin: https://github.com/percona/proxysql-admin-tool/pull/222
And we are no more hitting the same issue, but it seems there are other issues.
I propose we approve the proxysql-admin change (since it's simple and analog to what was already done) and continue fixing operator for this use case (if we decide that it is worth it).
For example, operator is printing this in the logs:
If you try to connect to read-only cluster through proxysql endpoint and execute some read-only query it will fail because it expects nodes in hostgroup 11, but there aren't any:
The replication starts to get into "Waiting for dependent transaction to commit" after some time working and at the current moment I'm not sure what is causing it (I was running sysbench load).
But the pods seem to be running:
This is related to this fix: https://jira.percona.com/browse/K8SPXC-835
Second proxysql node is getting into crashloop and will not recover:
pxc-monit part of log:
But other two proxysql pods seem to work fine.
Operator has this in the logs:
I have uploaded cr files and pxc-monit containers logs.