backup fails if backup user password rotated

Description

I have rotated all users passwords (including the one for backup user), after that the backup fails and backup-agents are unable to authenticate.

$ kubectl logs my-cluster-name-rs0-0 backup-agent 2020/08/06 09:07:56 [ERROR] wrting log: db: connection() : auth error: sasl conversation error: unable to authenticate using mechanism "SCRAM-SHA-256": (AuthenticationFailed) Authentication failed., <nil>, entry: 2020/08/06 09:07:56 [ERROR] listening commands: watch the cmd stream: connection() : auth error: sasl conversation error: unable to authenticate using mechanism "SCRAM-SHA-256": (AuthenticationFailed) Authentication failed. 2020/08/06 09:07:56 [ERROR] listening commands: watch the cmd stream: connection() : auth error: sasl conversation error: unable to authenticate using mechanism "SCRAM-SHA-256": (AuthenticationFailed) Authentication failed. 2020/08/06 09:07:56 [ERROR] wrting log: db: connection() : auth error: sasl conversation error: unable to authenticate using mechanism "SCRAM-SHA-256": (AuthenticationFailed) Authentication failed., <nil>, entry: 2020/08/06 09:07:56 [ERROR] listening commands: watch the cmd stream: connection() : auth error: sasl conversation error: unable to authenticate using mechanism "SCRAM-SHA-256": (AuthenticationFailed) Authentication failed. 2020/08/06 09:07:56 [ERROR] listening commands: watch the cmd stream: connection() : auth error: sasl conversation error: unable to authenticate using mechanism "SCRAM-SHA-256": (AuthenticationFailed) Authentication failed. 2020/08/06 09:07:56 [ERROR] wrting log: db: connection() : auth error: sasl conversation error: unable to authenticate using mechanism "SCRAM-SHA-256": (AuthenticationFailed) Authentication failed., <nil>, entry: 2020/08/06 09:07:56 [ERROR] listening commands: watch the cmd stream: connection() : auth error: sasl conversation error: unable to authenticate using mechanism "SCRAM-SHA-256": (AuthenticationFailed) Authentication failed. 2020/08/06 09:07:56 [ERROR] listening commands: watch the cmd stream: connection() : auth error: sasl conversation error: unable to authenticate using mechanism "SCRAM-SHA-256": (AuthenticationFailed) Authentication failed. 2020/08/06 09:07:56 [ERROR] wrting log: db: connection() : auth error: sasl conversation error: unable to authenticate using mechanism "SCRAM-SHA-256": (AuthenticationFailed) Authentication failed., <nil>, entry: 2020/08/06 09:07:56 [ERROR] listening commands: watch the cmd stream: connection() : auth error: sasl conversation error: unable to authenticate using mechanism "SCRAM-SHA-256": (AuthenticationFailed) Authentication failed. 2020/08/06 09:07:56 [ERROR] listening commands: watch the cmd stream: connection() : auth error: sasl conversation error: unable to authenticate using mechanism "SCRAM-SHA-256": (AuthenticationFailed) Authentication failed. 2020/08/06 09:07:56 [ERROR] wrting log: db: connection() : auth error: sasl conversation error: unable to authenticate using mechanism "SCRAM-SHA-256": (AuthenticationFailed) Authentication failed., <nil>, entry: 2020/08/06 09:07:56 [ERROR] listening commands: watch the cmd stream: connection() : auth error: sasl conversation error: unable to authenticate using mechanism "SCRAM-SHA-256": (AuthenticationFailed) Authentication failed.

We should probably put some mechanism that if backup user password is rotated that the backup-agents are restarted or something similar.

Environment

None

Smart Checklist

Activity

Done

Details

Assignee

Reporter

Time tracking

2h 30m logged

Fix versions

Priority

Smart Checklist

Created August 6, 2020 at 9:12 AM
Updated March 5, 2024 at 5:06 PM
Resolved August 26, 2020 at 9:28 AM

Flag notifications