nightly

Automated nightly release, will be updated every day at 20:00 UTC

1.6.0-rc0

What's Changed

• fix(e2e): cherry pick to fix e2e by @woshigaopp in #2756
• feat(zerozone2): add zero zone v2 support by @superhx in #2767
• feat(all): cherry-pick by @superhx in #2774
• chore(metrics): optimize metrics name mapping in S3MetricsExporter (#2775) by @Gezi-lzq in #2776
• fix(core): fix lock object error when implementing singleton pattern by @superhx in #2779
• fix(zerozone2): fix failover bug caused by #2764 by @superhx in #2781
• chore(config): dynamic change config based on heap size by @superhx in #2783
• chore(metrics): unify object wal metrics by @superhx in #2785
• refactor(zerozone2): make wal provider more extensible (#2787) by @superhx in #2788
• feat(zerozone2): force route to local by @superhx in #2790
• chore(zerozone2): rename channelOffset targetNodeId to attributes by @superhx in #2794
• chore(e2e): accelerate e2e by @superhx in #2800
• feat(java): set min java version to 17 by @superhx in #2804
• fix(zerozone2): fix potential WAL reset overflow BUG by @superhx in #2806
• perf(zerozone2): optimize the wal batch upload strategy by @superhx in #2810
• chore(workflows): add publish maven package workflow by @superhx in #2813
• fix(workflow): set the gradle version by @superhx in #2815
• feat: enhanced table topic conversion function by @Gezi-lzq in #2818
• chore(config): update default commit interval to 1 minute for table topic (#2819) by @Gezi-lzq in #2820
• feat(reassign): optimize partition reassignment to avoid client fast retry by @superhx in #2822
• feat(release): release 1.6.0-rc0 by @superhx in #2823
• feat(strimzi): add docker build for strimzi by @Rancho-7 in #2826

Full Changelog: 1.5.4...1.6.0-rc0

1.5.5

What's Changed

• fix(e2e): cherry pick to fix e2e by @woshigaopp in #2756
• fix(failover): fix failover get wrong node config by @superhx in #2760
• feat(release): release 1.5.5 by @superhx in #2761

Full Changelog: 1.5.4...1.5.5

1.5.4

What's Changed

• fix: support list more than 1000 objects by prefix (#2660) by @Gezi-lzq in #2666
• perf(misc): optimize FairLimiter implementation (#2670) by @superhx in #2672
• fix(worker): update CommitResponse to use partition type from writerF… by @Gezi-lzq in #2679
• feat(block-wal): use version V1 and support sequential return by @Chillax-0v0 in #2681
• feat(catalog): avoid static global credentials provider (#2684) by @Gezi-lzq in #2686
• perf(s3stream): avoid S3StreamSetObject objectId long primitive unbox… by @superhx in #2694
• chore(github): change code owners by @superhx in #2696
• feat(log): enhance reading logic to handle offset gaps and add unit tests (#2699) by @Gezi-lzq in #2701
• fix: resolve Base64 decoding error in certificate parsing (#2615) (#2… by @woshigaopp in #2707
• fix(logCleaner): optimize write buffer management and clear buffer before use (#2704) by @Gezi-lzq in #2711
• fix(log): Prevent potential offset overflow in ElasticLogSegment (#2720) by @Gezi-lzq in #2726
• perf(log): increase FETCH_BATCH_SIZE to 512KB in StreamSegmentInputStream (#2722) by @Gezi-lzq in #2730
• feat: modify for enterprise e2e by @woshigaopp in #2733
• fix(streamReader): implement scheduled cleanup for expired stream readers (#2719) by @Gezi-lzq in #2735
• fix: Added support for AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY by @superhx in #2748
• fix(s3stream): add pending requests await timeout for S3Stream#close by @superhx in #2751
• fix(s3stream): fix the network out over-consumed (#2752) by @superhx in #2753
• feat(release): release 1.5.4 by @superhx in #2755

Full Changelog: 1.5.3...1.5.4

1.5.3

What's Changed

• chore(tools/perf): log client logs to a separate file by @Chillax-0v0 in #2645
• fix(deps): resolve logging conflicts from Hive Metastore (#2648) by @Gezi-lzq in #2649
• feat(release): release 1.5.3-rc0 by @Gezi-lzq in #2651
• fix(image): guard streams image access with lock to prevent data loss (#2653) by @superhx in #2654
• fix(s3stream): avoid StreamMetadataManager add callback when retry (#… by @Gezi-lzq in #2661
• chore(container): update welcome message and container patch (#2658) by @1sonofqiu in #2664
• feat(release): 1.5.3 by @superhx in #2663

Full Changelog: 1.5.2...1.5.3

1.5.3-rc0

What's Changed

• chore(tools/perf): log client logs to a separate file by @Chillax-0v0 in #2645
• fix(deps): resolve logging conflicts from Hive Metastore (#2648) by @Gezi-lzq in #2649
• feat(release): release 1.5.3-rc0 by @Gezi-lzq in #2651

Full Changelog: 1.5.2...1.5.3-rc0

1.5.2

What's Changed

• feat(auto_balancer): only use pending append/fetch latency to identif… by @SCNieh in #2632
• fix(metadata): ensure correct GroupCoordinator updates for topic dele… by @Gezi-lzq in #2635
• feat(tabletopic): default include hive catalog dependencies by @superhx in #2637
• fix(docker): update minio policy commands to use 'anonymous' instead of 'policy' (#2640) by @Gezi-lzq in #2641
• feat(release): release 1.5.2 by @superhx in #2639

Full Changelog: 1.5.1...1.5.2

1.5.1

What's Changed

• perf(tool/perf): reduce the record header size by @Chillax-0v0 in #2580
• chore(all): make code more extendable by @superhx in #2582
• fix(stream): obey aws auth chain by @superhx in #2585
• chore(chart): update demo-values.yaml to correct AWS environment variable names by @1sonofqiu in #2588
• refactor(s3stream): in preparation for segmented recovery (#2589) by @Chillax-0v0 in #2590
• refactor(s3stream): preparation for segmented recovery by @Chillax-0v0 in #2592
• fix(s3stream): fix node epoch outdated by @superhx in #2595
• perf(s3stream): recover and upload data in segments by @Chillax-0v0 in #2596
• fix(s3client): limit the network usage of object storages by @Chillax-0v0 in #2600
• perf(s3client): increase outbound network limiter pool size by @Chillax-0v0 in #2603
• feat(tools/perf): log cpu, memory usage and min latency by @Chillax-0v0 in #2611
• fix(e2e): cherry pick fix e2e 1.5 by @woshigaopp in #2616
• fix(quota): update broker quota configs on "--broker-defaults" by @Chillax-0v0 in #2618
• fix(docker): update MinIO command from config host to alias set by @Gezi-lzq in #2628
• fix(docker): update AutoMQ image version to 1.5.1 in docker-compose files by @Gezi-lzq in #2630

Full Changelog: 1.5.0...1.5.1

1.4.1

What's Changed

• perf(s3stream): recover and upload data in segments by @Chillax-0v0 in #2597
• fix(s3client): limit the network usage of object storages by @Chillax-0v0 in #2599
• perf(s3client): increase outbound network limiter pool size by @Chillax-0v0 in #2604
• feat(tools/perf): log cpu, memory usage and min latency by @Chillax-0v0 in #2612
• fix(quota): update broker quota configs on "--broker-defaults" by @Chillax-0v0 in #2619
• chore(release): release 1.4.1 by @Chillax-0v0 in #2624

Full Changelog: 1.4.0...1.4.1

1.5.0

New Feature

• Support produce / consume zone alignment to save inter zone traffic cost.
• Support table topic to seamless ingest Kafka records to Iceberg table.
• Support deploy on Kubernetes.

What's Changed

• feat(zerozone): support zero cross az traffic cost by @superhx in #2506
• fix(s3stream): fix backward compatibility of default aws credentials by @SCNieh in #2510
• feat(table_topic): add table topic support (#2511) by @superhx in #2513
• feat(failover): add wal failover support (#2516) by @superhx in #2517
• fix(test): fix e2e dependencies conflict (#2518) by @superhx in #2519
• feat(cli): add default s3 wal config by @SCNieh in #2512
• feat(table): validate table config by @superhx in #2523
• chore(test): increase timeout for write completion in AbstractObjectSto… by @Gezi-lzq in #2536
• feat(zerozone): fast upload when snapshot-read enable by @superhx in #2534
• fix(storage): fix upload wal rate missing by @superhx in #2528
• fix(s3stream): add delayed deletion for S3 WAL by @SCNieh in #2525
• fix(s3stream/wal): fix incorrect offset return value during recovery by @Chillax-0v0 in #2543
• fix(github-release): correct IS_LATEST variable usage in upload condi… by @Gezi-lzq in #2538
• refactor(s3stream/object-wal): complete appends sequentially by @Chillax-0v0 in #2549
• fix(perf): unify the time in different nodes by @superhx in #2554
• feat(config): remove client logs from stdout by @superhx in #2565
• feat(docker): add Spark Iceberg Docker setup and demonstration notebook by @Gezi-lzq in #2567
• chore(log): log readiness check result to stdout by @superhx in #2568
• feat: cherry-pick 2560 by @1sonofqiu in #2571
• feat(container): cp_2561_2570_2562_2574 by @1sonofqiu in #2575
• feat(docker): cherry pick #2468 #2469 by @superhx in #2576
• feat(release): release 1.5.0 by @superhx in #2577

Full Changelog: 1.4.0...1.5.0

NOTE: 1.5.0 and later versions offer full S3 support, while EBS and Regional EBS support have been moved to the Enterprise Edition.