Skip to content

Import into using global sort failed with error "failed to get gcs file attribute" on gcp #49717

@aytrack

Description

@aytrack

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

  1. Import into data from gcs and use gcs as cloud storage

2. What did you expect to see? (Required)

Import success

3. What did you see instead (Required)

[14:52:33]TiDB root:test> show import jobs \G
Job_ID           | 2
Data_Source      | gs://xxxx.*csv
Target_Table     | `test`.`xxx`
Table_ID         | 102
Phase            | importing
Status           | failed
Source_File_Size | 9.535TiB
Imported_Rows    | <null>
Result_Message   | failed to get gcs file attribute, file info: input.bucket='xxx', input.key='2/32/data/aa7061f5-4230-4697-bebe-d6b2f64916b6_stat/40': Get "https://storage.googleapis.com/storage/v1/b/xxx%2Faa7061f5-4230-4697-bebe-d6b2f64916b6_stat%2F40?alt=json&prettyPrint=false&projection=full": write tcp 10.65.88.3:40373->172.253.117.207:443: write: broken pipe
Create_Time      | 2023-12-22 03:31:50.555484
Start_Time       | 2023-12-22 03:31:53.923179
End_Time         | 2023-12-22 06:51:03.490446
Created_By       | root@%

4. What is your TiDB version? (Required)

[15:09:25]TiDB root:test> select tidb_version();
+-----------------------------------------------------------+
| tidb_version()                                            |
+-----------------------------------------------------------+
| Release Version: v7.6.0-alpha                             |
| Edition: Community                                        |
| Git Commit Hash: 5c279d800774ae7ce5ff9934e1334740f1c7207b |
| Git Branch: heads/refs/tags/v7.6.0-alpha                  |
| UTC Build Time: 2023-12-21 07:56:10                       |
| GoVersion: go1.21.5                                       |
| Race Enabled: false                                       |
| Check Table Before Drop: false                            |
| Store: tikv                                               |
+-----------------------------------------------------------+

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions