Issues

Select view

Select search mode

 

Physical backup fails on MongoDB v4.4

Won't Do

Description

PBM version:

 

Version:   2.0.4 Platform:  linux/amd64 GitCommit: 785ee592ade9eb86be656af0af4da73b2f6055e1 GitBranch: release-2.0.4 BuildTime: 2023-02-15_17:01_UTC GoVersion: go1.19

MongoDB version:

Build Info: {     "version": "4.4.10-11",     "gitVersion": "17077507fedd996277adb88715c384329950898b",     "openSSLVersion": "OpenSSL 1.1.1g FIPS  21 Apr 2020",     "modules": [],     "allocator": "tcmalloc",     "environment": {         "distarch": "x86_64",         "target_arch": "x86_64"     } }

PBM logs:

2023-09-07T07:08:49Z I [rs0/some-name-rs0-2.some-name-rs0.demand-backup-physical-sharded-18140.svc.cluster.local:27017] got epoch {1694070518 1} 2023-09-07T07:08:49Z D [cfg/some-name-cfg-2.some-name-cfg.demand-backup-physical-sharded-18140.svc.cluster.local:27017] [backup/2023-09-07T07:08:49Z] skip after nomination, probably started by another node 2023-09-07T07:08:49Z D [cfg/some-name-cfg-1.some-name-cfg.demand-backup-physical-sharded-18140.svc.cluster.local:27017] [backup/2023-09-07T07:08:49Z] waiting for balancer off 2023-09-07T07:08:49Z I [rs0/some-name-rs0-1.some-name-rs0.demand-backup-physical-sharded-18140.svc.cluster.local:27017] got command backup [name: 2023-09-07T07:08:49Z, compression: gzip (level: default)] <ts: 1694070529> 2023-09-07T07:08:49Z I [rs0/some-name-rs0-1.some-name-rs0.demand-backup-physical-sharded-18140.svc.cluster.local:27017] got epoch {1694070518 1} 2023-09-07T07:08:50Z D [cfg/some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-18140.svc.cluster.local:27017] [backup/2023-09-07T07:08:49Z] skip after nomination, probably started by another node 2023-09-07T07:08:50Z I [rs0/some-name-rs0-2.some-name-rs0.demand-backup-physical-sharded-18140.svc.cluster.local:27017] [backup/2023-09-07T07:08:49Z] backup started 2023-09-07T07:08:50Z D [cfg/some-name-cfg-1.some-name-cfg.demand-backup-physical-sharded-18140.svc.cluster.local:27017] [backup/2023-09-07T07:08:49Z] balancer status: off 2023-09-07T07:08:50Z D [rs0/some-name-rs0-1.some-name-rs0.demand-backup-physical-sharded-18140.svc.cluster.local:27017] [backup/2023-09-07T07:08:49Z] skip after nomination, probably started by another node 2023-09-07T07:08:50Z D [rs0/some-name-rs0-0.some-name-rs0.demand-backup-physical-sharded-18140.svc.cluster.local:27017] [backup/2023-09-07T07:08:49Z] skip after nomination, probably started by another node 2023-09-07T07:08:51Z I [cfg/some-name-cfg-1.some-name-cfg.demand-backup-physical-sharded-18140.svc.cluster.local:27017] [backup/2023-09-07T07:08:49Z] mark RS as error `get backup files: create backupCursor: (Location31403) Failed to get a file's size. Filename: /data/db/key.db/journal/WiredTigerLog.0000000003 Error: No such file or directory`: <nil> 2023-09-07T07:08:51Z I [cfg/some-name-cfg-1.some-name-cfg.demand-backup-physical-sharded-18140.svc.cluster.local:27017] [backup/2023-09-07T07:08:49Z] mark backup as error `get backup files: create backupCursor: (Location31403) Failed to get a file's size. Filename: /data/db/key.db/journal/WiredTigerLog.0000000003 Error: No such file or directory`: <nil> 2023-09-07T07:08:51Z D [cfg/some-name-cfg-1.some-name-cfg.demand-backup-physical-sharded-18140.svc.cluster.local:27017] [backup/2023-09-07T07:08:49Z] set balancer on 2023-09-07T07:08:51Z E [cfg/some-name-cfg-1.some-name-cfg.demand-backup-physical-sharded-18140.svc.cluster.local:27017] [backup/2023-09-07T07:08:49Z] backup: get backup files: create backupCursor: (Location31403) Failed to get a file's size. Filename: /data/db/key.db/journal/WiredTigerLog.0000000003 Error: No such file or directory 2023-09-07T07:08:51Z D [cfg/some-name-cfg-1.some-name-cfg.demand-backup-physical-sharded-18140.svc.cluster.local:27017] [backup/2023-09-07T07:08:49Z] releasing lock 2023-09-07T07:08:51Z I [rs0/some-name-rs0-2.some-name-rs0.demand-backup-physical-sharded-18140.svc.cluster.local:27017] [backup/2023-09-07T07:08:49Z] mark RS as error `waiting for start: cluster failed: <nil>`: <nil> 2023-09-07T07:08:51Z D [rs0/some-name-rs0-2.some-name-rs0.demand-backup-physical-sharded-18140.svc.cluster.local:27017] [backup/2023-09-07T07:08:49Z] set balancer on 2023-09-07T07:08:51Z E [rs0/some-name-rs0-2.some-name-rs0.demand-backup-physical-sharded-18140.svc.cluster.local:27017] [backup/2023-09-07T07:08:49Z] backup: waiting for start: cluster failed: <nil> 2023-09-07T07:08:51Z D [rs0/some-name-rs0-2.some-name-rs0.demand-backup-physical-sharded-18140.svc.cluster.local:27017] [backup/2023-09-07T07:08:49Z] releasing lock 2023-09-07T07:08:54Z D [cfg/some-name-cfg-0.some-name-cfg.demand-backup-physical-sharded-18140.svc.cluster.local:27017] [backup/2023-09-07T07:08:49Z] bcp nomination: rs0 won by some-name-rs0-2.some-name-rs0.demand-backup-physical-sharded-18140.svc.cluster.local:27017

 

 

Environment

None

Details

Assignee

Reporter

Needs QA

Yes

Affects versions

Priority

Smart Checklist

Created September 7, 2023 at 7:25 AM
Updated October 4, 2023 at 12:25 PM
Resolved October 4, 2023 at 12:25 PM

Activity

Show:

Dmytro ZghobaSeptember 28, 2023 at 6:58 AM

 It is not a bug in PBM (out of our control). We cannot fix/workaround for PSMDB 4.4.10-11.

Oleksandr HavryliakSeptember 7, 2023 at 7:51 AM

This issue has been fixed in https://perconadev.atlassian.net/browse/PSMDB-1119#icft=PSMDB-1119 ( 4.4.16-16 )