import into failed when inject global sort dir network delay 50ms with error “read xxx bytes from external storage, exceed max limit 1073741824” #50451
Description
Bug Report
Please answer these questions before submitting your issue. Thanks!
1. Minimal reproduce step (Required)
1、tidb_enable_dist_task='on' and
2、enable global sort and tidb_cloud_storage_uri is set to minio dir
3、run import into
4、inject minio network delay 50ms
2. What did you expect to see? (Required)
import into can success
3. What did you see instead (Required)
import failed
the status of import job is not finished or running (now: 2024-01-16 02:48:14, jobId: 150003, step: importing, status: failed)
operatorLogs:
[2024-01-16 02:28:44] ###### start import into
[2024-01-16 02:28:44] ###### wait for import job to finish
[2024-01-16 02:48:14] ###### wait for import job to finish failed
select id, step, status from mysql.tidb_import_jobs where start_time >= '2024-01-16 02:28:44'
jobId: 150003, step: importing, status: failed
tidb logs：
[2024/01/16 02:48:06.486 +08:00] [ERROR] [reader.go:49] ["read all data failed"] [takeTime=2m27.255433123s] [error="failed to read file 150003/90036/data/b0dba35c-6041-47e1-af29-cc98ec29d765/40: read 316276121654947278 bytes from external storage, exceed max limit 1073741824"]
4. What is your TiDB version? (Required)
./tidb-server -V
Release Version: v7.6.0
Edition: Community
Git Commit Hash: 42960c3
Git Branch: heads/refs/tags/v7.6.0
UTC Build Time: 2024-01-15 11:33:46
GoVersion: go1.21.5
Race Enabled: false
Check Table Before Drop: false
Store: unistore
2024-01-16T02:28:41.835+0800