Skip to content

Commit e1e3f38

Browse files
committed
[docs] Add checkpoint configuration limitation for Oracle and Postgres connector
1 parent 5f3393c commit e1e3f38

File tree

2 files changed

+25
-0
lines changed

2 files changed

+25
-0
lines changed

docs/content/connectors/oracle-cdc.md

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -231,6 +231,19 @@ Connector Options
231231
</table>
232232
</div>
233233

234+
Limitation
235+
--------
236+
237+
### Can't perform checkpoint during scanning snapshot of tables
238+
During scanning snapshot of database tables, since there is no recoverable position, we can't perform checkpoints. In order to not perform checkpoints, Oracle CDC source will keep the checkpoint waiting to timeout. The timeout checkpoint will be recognized as failed checkpoint, by default, this will trigger a failover for the Flink job. So if the database table is large, it is recommended to add following Flink configurations to avoid failover because of the timeout checkpoints:
239+
240+
```
241+
execution.checkpointing.interval: 10min
242+
execution.checkpointing.tolerable-failed-checkpoints: 100
243+
restart-strategy: fixed-delay
244+
restart-strategy.fixed-delay.attempts: 2147483647
245+
```
246+
234247
Features
235248
--------
236249

docs/content/connectors/postgres-cdc.md

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -189,6 +189,18 @@ The following format metadata can be exposed as read-only (VIRTUAL) columns in a
189189
</table>
190190
</div>
191191

192+
Limitation
193+
--------
194+
195+
### Can't perform checkpoint during scanning snapshot of tables
196+
During scanning snapshot of database tables, since there is no recoverable position, we can't perform checkpoints. In order to not perform checkpoints, Postgres CDC source will keep the checkpoint waiting to timeout. The timeout checkpoint will be recognized as failed checkpoint, by default, this will trigger a failover for the Flink job. So if the database table is large, it is recommended to add following Flink configurations to avoid failover because of the timeout checkpoints:
197+
198+
```
199+
execution.checkpointing.interval: 10min
200+
execution.checkpointing.tolerable-failed-checkpoints: 100
201+
restart-strategy: fixed-delay
202+
restart-strategy.fixed-delay.attempts: 2147483647
203+
```
192204

193205
Features
194206
--------

0 commit comments

Comments
 (0)