Skip to content

br: add table filter for Pitr restore #57613

@Tristan1900

Description

@Tristan1900

Feature Request

Right now only snapshot backup/restore supports filter, users are asking for PiTR to support it. We only need to add filter for log restore and not log backup.

Need to consider table rename corner cases

  1. table renamed into the filter during log replay should be kept after restore
  2. table renamed out of filter range during log replay should be dropped after restore
  3. Should naturally works with insertGCRow, repairIndex and TiFlash
  4. Partitions exchanged across the filter boundary should not be supported and will error out

This issue now becomes a covering issue for multiple other functionalities including:

  1. Online filtered restore: need to refresh schema change by tables and not full load otherwise can freeze DDL op for the entire cluster.
  2. Parallel restore: to allow multiple restore tasks with disjoint filters to proceed at the same time
  3. Log backup compatibility: allow log backup turned on while doing PiTR
  4. Better scheduler control: only set on tables that are going to restore instead of all.

Tasks:

Bugfixes

Metadata

Metadata

Assignees

No one assigned

    Labels

    affects-8.5This bug affects the 8.5.x(LTS) versions.component/brThis issue is related to BR of TiDB.type/feature-requestCategorizes issue or PR as related to a new feature.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions