2025-02-28T10:34:45Z D [rs0/some-name-rs0-0.some-name-rs0.multi-storage-31372.svc.cluster.local:27017] [pitr] agents in ready: 2; waiting for agents: 3
2025-02-28T10:34:47Z D [rs0/some-name-rs0-0.some-name-rs0.multi-storage-31372.svc.cluster.local:27017] [pitr] agents in ready: 2; waiting for agents: 3
2025-02-28T10:34:49Z D [rs0/some-name-rs0-0.some-name-rs0.multi-storage-31372.svc.cluster.local:27017] [pitr] agents in ready: 2; waiting for agents: 3
2025-02-28T10:34:51Z D [rs0/some-name-rs0-0.some-name-rs0.multi-storage-31372.svc.cluster.local:27017] [pitr] agents in ready: 2; waiting for agents: 3
2025-02-28T10:34:53Z D [rs0/some-name-rs0-0.some-name-rs0.multi-storage-31372.svc.cluster.local:27017] [pitr] agents in ready: 2; waiting for agents: 3
I did the following operations:
rs0 [direct: primary] admin> db.pbmCmd.find() [ { _id: ObjectId('67c185a0d424f53968f6212a'), cmd: 'resync', ts: Long('1740735904') }, { _id: ObjectId('67c185add424f53968f62135'), cmd: 'backup', backup: { type: 'logical', base: false, name: '2025-02-28T09:45:17Z', compression: 'gzip' }, ts: Long('1740735917') }, { _id: ObjectId('67c185c3d424f53968f62146'), cmd: 'backup', backup: { type: 'logical', base: false, name: '2025-02-28T09:45:39Z', compression: 'gzip', profile: 'minio-2' }, ts: Long('1740735939') }, { _id: ObjectId('67c185d9d424f53968f62156'), cmd: 'backup', backup: { type: 'physical', base: false, name: '2025-02-28T09:46:01Z', compression: 'gzip', profile: 'minio-3' }, ts: Long('1740735961') } ]This is the PBM status:
$ k exec -it some-name-rs0-0 -c backup-agent -- pbm status Cluster: ======== rs0: - some-name-rs0-0.some-name-rs0.multi-storage-31372.svc.cluster.local:27017 [P]: pbm-agent [v2.9.0] OK - some-name-rs0-1.some-name-rs0.multi-storage-31372.svc.cluster.local:27017 [S]: pbm-agent [v2.9.0] OK - some-name-rs0-2.some-name-rs0.multi-storage-31372.svc.cluster.local:27017 [S]: pbm-agent [v2.9.0] OK PITR incremental backup: ======================== Status [ON] ! ERROR while running PITR backup: 2025-02-28T10:30:45.000+0000 E [rs0/some-name-rs0-0.some-name-rs0.multi-storage-31372.svc.cluster.local:27017] [pitr] reconciling ready status: timeout while reconciling ready status Currently running: ================== (none) Backups: ======== S3 us-east-1 http://minio-service:9000//operator-testing Snapshots: 2025-02-28T09:46:01Z 1.10MB <physical, *> [restore_to_time: 2025-02-28T09:46:02Z] 2025-02-28T09:45:39Z 54.75KB <logical, *> [restore_to_time: 2025-02-28T09:45:44Z] 2025-02-28T09:45:17Z 48.13KB <logical> [restore_to_time: 2025-02-28T09:45:22Z] PITR chunks [41.62KB]: 2025-02-28T09:45:23Z - 2025-02-28T09:45:40ZThis is the status of
pbmPITRcollection:rs0 [direct: primary] admin> db.pbmPITR.find() [ { _id: ObjectId('67c185b548ccfd87117b8d04'), start_ts: Long('1740738525'), hb: Timestamp({ t: 1740738645, i: 1 }), status: 'ready', n: [], replsets: [ { name: 'rs0', node: 'some-name-rs0-2.some-name-rs0.multi-storage-31372.svc.cluster.local:27017', status: 'ready' }, { name: 'rs0', node: 'some-name-rs0-0.some-name-rs0.multi-storage-31372.svc.cluster.local:27017', status: 'ready' } ] } ]PBM logs filled with the following messages:
2025-02-28T10:34:45Z D [rs0/some-name-rs0-0.some-name-rs0.multi-storage-31372.svc.cluster.local:27017] [pitr] agents in ready: 2; waiting for agents: 3 2025-02-28T10:34:47Z D [rs0/some-name-rs0-0.some-name-rs0.multi-storage-31372.svc.cluster.local:27017] [pitr] agents in ready: 2; waiting for agents: 3 2025-02-28T10:34:49Z D [rs0/some-name-rs0-0.some-name-rs0.multi-storage-31372.svc.cluster.local:27017] [pitr] agents in ready: 2; waiting for agents: 3 2025-02-28T10:34:51Z D [rs0/some-name-rs0-0.some-name-rs0.multi-storage-31372.svc.cluster.local:27017] [pitr] agents in ready: 2; waiting for agents: 3 2025-02-28T10:34:53Z D [rs0/some-name-rs0-0.some-name-rs0.multi-storage-31372.svc.cluster.local:27017] [pitr] agents in ready: 2; waiting for agents: 3