Skip to content

drainer error #7744

@sakufo

Description

@sakufo

After using the drainer output to the downstream mysql prompt the following error, check the downstream database, no data updates.
please help.

2018/09/19 16:00:53 server.go:81: [info] clusterID of drainer server is 6580197893879686949
2018/09/19 16:00:53 checkpoint.go:48: [info] initialize mysql type checkpoint binlog commitTS = 403001324297519112 and positions = map[] with config &{Db:0xc0002ca8c0 Schema:tidb_binlog Table:checkpoint ClusterID:6580197893879686949 InitialCommitTS:403001324297519112 CheckPointFile:data.drainer/savepoint}
2018/09/19 16:00:53 offset_seeker.go:82: [info] kafka consumer version 0.8.2.0
2018/09/19 16:00:53 client.go:120: [sarama] Initializing new client
2018/09/19 16:00:53 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/19 16:00:53 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/19 16:00:53 client.go:701: [sarama] client/metadata fetching metadata for all topics from broker 10.10.8.29:9092
2018/09/19 16:00:53 broker.go:148: [sarama] Connected to broker at 10.10.8.29:9092 (unregistered)
2018/09/19 16:00:53 client.go:477: [sarama] client/brokers registered new broker #2 at 10.10.8.24:9092
2018/09/19 16:00:53 client.go:477: [sarama] client/brokers registered new broker #1 at 10.10.8.29:9092
2018/09/19 16:00:53 client.go:477: [sarama] client/brokers registered new broker #3 at 10.10.8.31:9092
2018/09/19 16:00:53 client.go:167: [sarama] Successfully initialized new client
2018/09/19 16:00:53 client.go:120: [sarama] Initializing new client
2018/09/19 16:00:53 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/19 16:00:53 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/19 16:00:53 client.go:701: [sarama] client/metadata fetching metadata for all topics from broker 10.10.8.31:9092
2018/09/19 16:00:53 broker.go:148: [sarama] Connected to broker at 10.10.8.31:9092 (unregistered)
2018/09/19 16:00:53 client.go:477: [sarama] client/brokers registered new broker #2 at 10.10.8.24:9092
2018/09/19 16:00:53 client.go:477: [sarama] client/brokers registered new broker #1 at 10.10.8.29:9092
2018/09/19 16:00:53 client.go:477: [sarama] client/brokers registered new broker #3 at 10.10.8.31:9092
2018/09/19 16:00:53 client.go:167: [sarama] Successfully initialized new client
2018/09/19 16:00:54 syncer.go:115: [info] [prepare] begin to construct schema infomation in syncer
2018/09/19 16:01:04 collector.go:365: [info] commit ts 403001324297519112's safe commit ts is 403001009724719112
2018/09/19 16:01:04 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/19 16:01:04 broker.go:146: [sarama] Connected to broker at 10.10.8.24:9092 (registered as #2)
2018/09/19 16:01:04 offset.go:115: [info] seek position 403001009724719112 in topic 6580197893879686949_VM_8_2_centos_8250 partition 0, oldest offset 0, newest offset 7111
2018/09/19 16:01:04 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/19 16:01:04 broker.go:146: [sarama] Connected to broker at 10.10.8.24:9092 (registered as #2)
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 assemble.go:110: [warning] assembler was canceled: context canceled
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 consumer.go:718: [sarama] consumer/broker/2 closed dead subscription to 6580197893879686949_VM_8_2_centos_8250/0
2018/09/19 16:01:04 offset.go:120: [info] seek position 403001009724719112 in topic 6580197893879686949_VM_8_2_centos_8250 partition 0, offset 1374
2018/09/19 16:01:04 collector.go:226: [info] node VM_8_2_centos:8250 get save point {0 1374}
2018/09/19 16:01:04 kafka.go:80: [info] kafka consumer version 0.8.2.0
2018/09/19 16:01:04 client.go:120: [sarama] Initializing new client
2018/09/19 16:01:04 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/19 16:01:04 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/19 16:01:04 client.go:701: [sarama] client/metadata fetching metadata for all topics from broker 10.10.8.24:9092
2018/09/19 16:01:04 broker.go:148: [sarama] Connected to broker at 10.10.8.24:9092 (unregistered)
2018/09/19 16:01:04 client.go:477: [sarama] client/brokers registered new broker #2 at 10.10.8.24:9092
2018/09/19 16:01:04 client.go:477: [sarama] client/brokers registered new broker #1 at 10.10.8.29:9092
2018/09/19 16:01:04 client.go:477: [sarama] client/brokers registered new broker #3 at 10.10.8.31:9092
2018/09/19 16:01:04 client.go:167: [sarama] Successfully initialized new client
2018/09/19 16:01:04 pump.go:433: [info] [pump VM_8_2_centos:8250] consume from topic 6580197893879686949_VM_8_2_centos_8250 partition 0 offset 1374
2018/09/19 16:01:04 config.go:382: [sarama] ClientID is the default of 'sarama', you should consider setting it to something application-specific.
2018/09/19 16:01:04 broker.go:146: [sarama] Connected to broker at 10.10.8.24:9092 (registered as #2)
2018/09/19 16:01:04 consumer.go:712: [sarama] consumer/broker/2 added subscription to 6580197893879686949_VM_8_2_centos_8250/0

Question

Before asking a question, make sure you have:

Metadata

Metadata

Assignees

No one assigned

    Labels

    type/questionThe issue belongs to a question.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions