replica cluster (cross-site) doesn't work with proxysql

Description

This is related to this fix: https://jira.percona.com/browse/K8SPXC-835

Second proxysql node is getting into crashloop and will not recover:

pxc-monit part of log:

But other two proxysql pods seem to work fine.

Operator has this in the logs:

I have uploaded cr files and pxc-monit containers logs.

Environment

None

Attachments

7

Smart Checklist

Activity

Pavel Tankov January 25, 2024 at 7:15 PM

I am receiving the same errors in the operator log as in the description of this bug:

plus, the replication does not happen.

what I did was:

  1. setup replication with haproxy

  2. make sure it works

  3. just change proxysql -> enabled and haproxy -> disabled

  4. setup replication again

  5. it doesn't work

 

natalia.marukovich December 6, 2022 at 6:08 PM

Using haproxy:

natalia.marukovich December 6, 2022 at 4:17 PM

For replica in pxc-monit logs I see:

But

natalia.marukovich December 6, 2022 at 4:07 PM
Edited

Replica cluster:
Operator log:

Both clusters in READY state

Replica status:

But data replicate from source cluster to the replica one.

Connect to proxysql in replica NS and can see all the data:

Tomislav Plavcic May 31, 2022 at 3:58 PM
Edited

I was checking this change in proxysql-admin: https://github.com/percona/proxysql-admin-tool/pull/222
And we are no more hitting the same issue, but it seems there are other issues.
I propose we approve the proxysql-admin change (since it's simple and analog to what was already done) and continue fixing operator for this use case (if we decide that it is worth it).

For example, operator is printing this in the logs:

If you try to connect to read-only cluster through proxysql endpoint and execute some read-only query it will fail because it expects nodes in hostgroup 11, but there aren't any:

The replication starts to get into "Waiting for dependent transaction to commit" after some time working and at the current moment I'm not sure what is causing it (I was running sysbench load).

But the pods seem to be running:

Details

Assignee

Reporter

Needs QA

Yes

Fix versions

Affects versions

Priority

Smart Checklist

Created May 24, 2022 at 5:14 PM
Updated February 26, 2025 at 1:31 PM