br: full backup in stuck when getting checkpoint #40165
Description
Bug Report
Please answer these questions before submitting your issue. Thanks!
1. Minimal reproduce step (Required)
- br backup full
2. What did you expect to see? (Required)
- no error
3. What did you see instead (Required)
- br get error but in stuck
[2022/12/23 10:12:17.669 +00:00] [ERROR] [client.go:936] ["can not find leader"] [key=748000000000008EFFB55F698000000000FF0000030000000000FB] [stack="github.com/pingcap/tidb/br/pkg/backup.(*Client).findRegionLeader\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/backup/client.go:936\ngithub.com/pingcap/tidb/br/pkg/backup.(*Client).handleFineGrained\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/backup/client.go:1147\ngithub.com/pingcap/tidb/br/pkg/backup.(*Client).fineGrainedBackup.func2\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/br/br/pkg/backup/client.go:993"] [2022/12/23 10:12:17.669 +00:00] [INFO] [client.go:821] ["backup range completed"] [range-sn=13660] [startKey=748000000000008EB55F69800000000000000300] [endKey=748000000000008EB55F698000000000000003FB] [take=7m11.723426318s] [2022/12/23 10:12:17.669 +00:00] [INFO] [client.go:772] ["Backup Ranges Completed"] [take=1h47m35.629267161s] [2022/12/23 10:12:17.669 +00:00] [INFO] [backup.go:598] ["wait for flush checkpoint..."] [2022/12/24 09:55:59.320 +00:00] [WARN] [pd.go:152] ["get timestamp too slow"] ["cost time"=58.430505ms] [2022/12/24 17:23:43.298 +00:00] [WARN] [pd.go:152] ["get timestamp too slow"] ["cost time"=36.093091ms] [2022/12/25 14:28:59.297 +00:00] [WARN] [pd.go:152] ["get timestamp too slow"] ["cost time"=34.710956ms]
4. What is your TiDB version? (Required)
/ # /br --version
Release Version: v6.5.0
Git Commit Hash: 4f93081
Git Branch: heads/refs/tags/v6.5.0
Go Version: go1.19.3
UTC Build Time: 2022-12-10 14:40:08
Race Enabled: false