Backup finalizer does not delete data from S3 if folder is specified
Description
Environment
Smart Checklist
Activity
Bulat Zamalutdinov September 22, 2021 at 7:24 PM
Hi !
Here is the pr for that issue which you can track
https://github.com/percona/percona-xtradb-cluster-operator/pull/999
申祥瑞 August 13, 2021 at 4:39 PM
Thank you, yes. Looking forward to the next version can fix this small problem.
Jira Bot August 13, 2021 at 1:56 PM
To: Former user
CC:
Hi, I'm jira-bot, Percona's Jira automation tool. I've detected that someone from
Percona has made an edit to the Summary field of an issue that you reported.
I'm not sentient (yet) so I'm not sure whether the person fixed a typo, changed
a few words, or completely rewrote the text. In any case, it is Percona Engineering's
intention to make the Summary and Description of an issue as accurate as possible
so that we're fixing the actual problem you're encountering, and to avoid
misunderstandings about symptoms and causes.
If the current Summary does not accurately reflect the problem you are reporting,
or if you feel the change was otherwise inappropriate in some way, please add a
new comment explaining things and we'll address it as soon as we can.
This message will be added only once per issue, regardless of how many times
the Summary is edited.
message-code:summary-edited
Lalit Choudhary August 13, 2021 at 1:41 PM
Hi
Thank you for the report.
Verified as described.
Issue: When S3 bucket name is set as a sub-directory path backup works fine, but at the time of backup deletion it fails with "error:failed to list objects: Bucket name contains invalid characters"
Example:
Test: google cloud storage, pxc-op 1.9
Backup not deleted from s3 storage.
Case2: Working as expected if specified only main bucket name
example:
hi, the big guys in the community are good, I encountered some problems while using PXC Operator backup (release-1.9.0).
I put the backups of different PXC clusters in different directories in the same S3 bucket, that is, use different directories to store the backup files of different PXC clusters
However, an error will be reported when deleting the backup, and the log content is:
{"level":"info","ts":1628648560.2557213,"caller":"zapr/zapr.go:69","msg":"Failed to delete backup from s3","backup path":"s3: //itd-test-perconabackup/itd-demo-db-backup/fullbackup/itd-demo-db-2021-08-11-02:29:59-full","error":"failed to list objects: Bucket name contains invalid characters"}
The content of my cr.yaml backup is as follows:
backup:
image: it/percona-xtradb-cluster-operator:1.9.0-pxc8.0-backup_cst
imagePullPolicy: IfNotPresent
pitr:
enabled: true
image: it/percona-xtradb-cluster-operator:1.9.0-pxc8.0-backup_cst
imagePullPolicy: IfNotPresent
storageName: hwcloud-obs-binlogbackup
timeBetweenUploads: 60
storages:
hwcloud-obs-fullbackup:
type: s3
s3:
bucket: itd-test-perconabackup/itd-demo123-db-backup/fullbackup
region: cn-east-2
credentialsSecret: percona-backup-hwcloud-obs
endpointUrl: https://obs.cn-east-2.myhuaweicloud.com
hwcloud-obs-binlogbackup:
type: s3
s3:
bucket: itd-test-perconabackup/itd-demo123-db-backup/binlogbackup/
region: cn-east-2
credentialsSecret: percona-backup-hwcloud-obs
endpointUrl: https://obs.cn-east-2.myhuaweicloud.com