PBM backup upload to S3 fails when s3 bucket locked with modify or delete

Description

When PBM uploads the physical backup files to S3 bucket with the restriction of delete/modify for few days, fails when a file is re-uploaded again in the backup like below:

 

For example key.db/WiredTigerLog.0000000010 in below example uploaded twice causing error in uploading at s3 end.

note: key.db directory is created when encryption for data at rest is enabled.

 

 

 

pbm.log showing file WiredTigerLog.0000000010 uploaded twice:

 

from captured related pbm query:

 

Environment

None

AFFECTED CS IDs

CS0036212

Activity

Show:

andrew.pogrebnoi May 18, 2023 at 10:00 AM

Looks like logs in key.db for encrypted dbs are changing more frequently so the same logs are being given back by both $backupCursor and $backupCursorExtended. PBM has to skip uploading of file duplicates

Details

Assignee

Reporter

Labels

Needs QA

Yes

Priority

Smart Checklist

Created May 18, 2023 at 7:35 AM
Updated January 21, 2025 at 12:28 PM