feat: enhanced table topic conversion function #2818
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
… Iceberg conversion (#2744) * feat(binder): implement AvroValueAdapter and RecordBinder for Avro to Iceberg conversion * chore(binder): preallocate list and map sizes
…erter and transform interfaces (#2786)
…#2792) refactor(process): unify error handling with InvalidDataException and update DataError types
Gezi-lzq
requested review from
superhx,
1sonofqiu and
woshigaopp
as code owners
superhx
previously approved these changes
Sep 5, 2025
…on/transform pipeline (#2796) * feat(process): introduce flexible record processor factory and enrich conversion/transform pipeline - Add RecordProcessorFactory to support dynamic creation of processors based on schema and transform configs - Refactor RegistryConverterFactory for improved schema format handling and converter instantiation - Implement SchemaFormat, TableTopicConvertType, and TableTopicTransformType enums for config-driven processing - Enhance Converter interface and conversion records to include key, value, and timestamp fields - Refactor AvroRegistryConverter and ProtobufRegistryConverter to return unified RecordData objects - Add ProtoToAvroConverter for robust Protobuf-to-Avro conversion - Update transform chain: add KafkaMetadataTransform for metadata enrichment, refactor DebeziumUnwrapTransform - Update DefaultRecordProcessor and TransformContext to support partition-aware processing - Improve error handling and code clarity across conversion and transform modules
Gezi-lzq
force-pushed
the
feat/table-topic
branch
from
b5ca790 to
24bfa61
Compare
… tolerance (#2814) * feat(table): integrate RecordProcessor architecture and enhance error tolerance * feat(process): handle system-level errors in schema registry interactions * chore(process): fix code style * feat(tests): update assertions for schema evolution and error handling in RecordProcessor tests * feat(process): simplify error handling for RestClientException in DefaultRecordProcessor * feat(errors): enhance ErrorsTolerance enum and streamline error tolerance configuration * feat(metrics): improve field count calculations for List and Map types * chore(format): improve code style in RecordBinder.java * feat(writer): modify offset range computation
superhx
approved these changes
Sep 5, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
cherry-pick: