It's not possible to make physical backups for databases with files greater 320GB
General
Escalation
General
Escalation
Description
S3 storages have a limitation with 10k parts. Higher chunk size could cause S3 server to crash due to out of RAM, e.g. with minio helm’s default limits:
Thus we should document that backup servers needs higher limits if we are using bigger chunks.
I’ve created a test cluster with:
Backup resource:
The test program for data generation:
Environment
None
AFFECTED CS IDs
CS0044779
Activity
natalia.marukovich September 16, 2024 at 2:23 PM
We discussed this task with and from our side we can just update documentation adding some notes about S3 server crush. cc
Nickolay Ihalainen May 17, 2024 at 4:43 PM
backup with big upload chunks could crash S3 server and instead of retry, the backup exists:
S3 storages have a limitation with 10k parts. Higher chunk size could cause S3 server to crash due to out of RAM, e.g. with minio helm’s default limits:
Thus we should document that backup servers needs higher limits if we are using bigger chunks.
I’ve created a test cluster with:
Backup resource:
The test program for data generation: