Skip to content

restore: scale link workers by number of nodes #146584

New issue
New issue
Open
#153065
Open
restore: scale link workers by number of nodes#146584
#153065
Assignees
kev-cao
Labels
300-nodes-qualification-blockerA-disaster-recoveryC-bugCode not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior.O-testclusterIssues found or occurred on a test cluster, i.e. a long-running internal clusterP-2Issues/test failures with a fix SLA of 3 monthsT-disaster-recoverybranch-masterFailures and bugs on the master branch.
@msbutler

Description

@msbutler
msbutler
opened on May 12, 2025

Currently, we default the number of link workers to 32 by a cluster setting. But the number of workers should scale by the number of nodes, allowing online restore to better parallelize the link phase. In a recent large scale test with 300 nodes, for example, 90% of nodes were chilling.

Jira issue: CRDB-50608

Epic CRDB-48786

Metadata

Metadata

Assignees

Labels

300-nodes-qualification-blockerA-disaster-recoveryC-bugCode not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior.O-testclusterIssues found or occurred on a test cluster, i.e. a long-running internal clusterP-2Issues/test failures with a fix SLA of 3 monthsT-disaster-recoverybranch-masterFailures and bugs on the master branch.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions