Daily backups not taken from all clusters

Description

Issue

When you deploy more than one cluster in a project, the daily backup job to fs only runs on one cluster.  In this environment it has flipped between both clusters, always successful, but never backing up both clusters during the same window.

Expected Behaviour

Each cluster deployed should get it's own daily backup to fs.

oc get pxc-backup

Backups are succeeding however they are only taken from one cluster at a time.  s3 fails since I did not configure AWS secrets.

What is very weird is how the backups ran Nov 8 on cluster1, Nov 9 on cluster2, then back to cluster1 for Nov 10-12, then finally onto cluster2  Nov 13-> .

oc get pods

We have two clusters (cluster1, cluster2) deployed for 20 days.

Deploy the second cluster by cloning cr.yaml and re-naming the cluster:

Environment

None

Smart Checklist

Activity

Mykola Marzhan November 18, 2020 at 7:56 AM

workaround: use different names for schedules

code fix should be:
add cluster name to k8s cronjob name, add check that schedule name lenght

Done

Details

Assignee

Reporter

Time tracking

3d 1h 45m logged

Fix versions

Affects versions

Priority

Smart Checklist

Created November 18, 2020 at 5:57 AM
Updated March 5, 2024 at 6:02 PM
Resolved February 8, 2021 at 8:28 AM