Add support for logical restore of sharded timeseries collections

Description

Currently, PBM fails to restore sharded timeseries collections. It is about full backup…

The error:

Waiting to finish...Error: operation failed with: waiting for dumpDone: cluster failed: reply oplog: replay chunk 1713279444.1713279454: apply oplog for chunk: applying an entry: op: {"Timestamp":{"T":1713279444,"I":10},"Term":1,"Hash":null,"Version":2,"Operation":"i","Namespace":"test.system.buckets.test2","Object":[{"Key":"_id","Value":"661e91bc365a196d71a84741"},{"Key":"control","Value":[{"Key":"version","Value":1},{"Key":"min","Value":[{"Key":"_id","Value":"661e91d4c744dbe1abcbb854"},{"Key":"timestamp","Value":"2024-04-16T14:57:00Z"}]},{"Key":"max","Value":[{"Key":"_id","Value":"661e91d4c744dbe1abcbb854"},{"Key":"timestamp","Value":"2024-04-16T14:57:24.546Z"}]}]},{"Key":"meta","Value":8},{"Key":"data","Value":[{"Key":"_id","Value":[{"Key":"0","Value":"661e91d4c744dbe1abcbb854"}]},{"Key":"timestamp","Value":[{"Key":"0","Value":"2024-04-16T14:57:24.546Z"}]}]}],"Query":[{"Key":"meta","Value":8},{"Key":"_id","Value":"661e91bc365a196d71a84741"}],"UI":null,"LSID":"SAAAAAVpZAAQAAAABFH31Pc1/krorTMFa/3BrXwFdWlkACAAAAAAY5mrDaxi8gv8RmdTsQ+1j7fmkr7JUsabhNmXAheU0fgA","TxnNumber":1,"PrevOpTime":"HAAAABF0cwAAAAAAAAAAABJ0AP//////////AA=="} | merr <nil>: applyOps: (NamespaceNotFound) cannot apply insert or update operation on a non-existent namespace test.system.buckets.test2: { ts: Timestamp(1713279444, 10), t: 1, v: 2, op: "i", ns: "test.system.buckets.test2", o: { _id: ObjectId('661e91bc365a196d71a84741'), control: { version: 1, min: { _id: ObjectId('661e91d4c744dbe1abcbb854'), timestamp: new Date(1713279420000) }, max: { _id: ObjectId('661e91d4c744dbe1abcbb854'), timestamp: new Date(1713279444546) } }, meta: 8, data: { _id: { 0: ObjectId('661e91d4c744dbe1abcbb854') }, timestamp: { 0: new Date(1713279444546) } } }, o2: { meta: 8, _id: ObjectId('661e91bc365a196d71a84741') }, lsid: { id: UUID("51f7d4f7-35fe-4ae8-ad33-056bfdc1ad7c"), uid: BinData(0, 6399AB0DAC62F20BFC466753B10FB58FB7E692BEC952C69B84D997021794D1F8) }, txnNumber: 1, prevOpTime: { ts: Timestamp(0, 0), t: -1 } }

 

This feature will be blocked when https://perconadev.atlassian.net/browse/PBM-1367 (subtask) will be completed.

Environment

None
0% Done

Activity

Jan Mynar 
May 6, 2024 at 9:49 AM

according to the discussion with option no.1 (informative message about disallowing the backup) is the way we should go right now.

Details

Assignee

Reporter

Labels

Needs QA

Needs Doc

Story Points

Priority

Created April 16, 2024 at 4:31 PM
Updated January 9, 2025 at 4:43 PM

Flag notifications