Skip to content

kafka avro 2 workloads lag execced 20s #1916

@River2000i

Description

@River2000i

What did you do?

cdc_kafka_avro_2_workloads

  1. create changefeed with
SinkType: ticdc.SinkTypeKafka,
			ID:       avroChangefeed,
			Options: map[string]string{
				"topic":                              avroTopic,
				"protocol":                           "avro",
				"partition-num":                      "2",
				"replication-factor":                 "2",
				"enable-tidb-extension":              "true",
				"avro-decimal-handling-mode":         "string",
				"avro-bigint-unsigned-handling-mode": "string",
				"avro-enable-watermark":              "true",
			},
  1. parallel run workload
    a. ycsb 1 bigtable, 10000000000 rows 32 threads
    b. yscb 2000 small tables, 200000000 rows 32 threads

What did you expect to see?

lag less than 20s

What did you see instead?

Image Image

Versions of the cluster

Upstream TiDB cluster version (execute SELECT tidb_version(); in a MySQL client):

(paste TiDB cluster version here)

Upstream TiKV version (execute tikv-server --version):

(paste TiKV version here)

TiCDC version (execute cdc version):

(paste TiCDC version here)

Metadata

Metadata

Assignees

No one assigned

    Labels

    contributionThis PR is from a community contributor.type/bugThe issue is confirmed as a bug.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions