Skip to content

"parallel hash aggregation panicked" with spill data to disk #61749

@dveeden

Description

@dveeden

Bug Report

1. Minimal reproduce step (Required)

2. What did you expect to see? (Required)

3. What did you see instead (Required)

github.com/pingcap/tidb/pkg/executor/aggregate.recoveryHashAgg
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggregate/agg_util.go:93
github.com/pingcap/tidb/pkg/executor/aggregate.(*HashAggPartialWorker).spillDataToDiskImpl.func1
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggregate/agg_hash_partial_worker.go:330
runtime.gopanic
	/go/pkg/mod/golang.org/[email protected]/src/runtime/panic.go:785
runtime.panicmem
	/go/pkg/mod/golang.org/[email protected]/src/runtime/panic.go:262
runtime.sigpanic
	/go/pkg/mod/golang.org/[email protected]/src/runtime/signal_unix.go:917
bytes.(*Buffer).Bytes
	/go/pkg/mod/golang.org/[email protected]/src/bytes/buffer.go:54
github.com/pingcap/tidb/pkg/util/serialization.SerializeBytesBuffer
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/util/serialization/serialization_util.go:171
github.com/pingcap/tidb/pkg/executor/aggfuncs.(*SerializeHelper).serializeBasePartialResult4GroupConcat
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggfuncs/spill_serialize_helper.go:135
github.com/pingcap/tidb/pkg/executor/aggfuncs.(*SerializeHelper).serializePartialResult4GroupConcat
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggfuncs/spill_serialize_helper.go:140
github.com/pingcap/tidb/pkg/executor/aggfuncs.(*groupConcat).SerializePartialResult
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggfuncs/func_group_concat.go:180
github.com/pingcap/tidb/pkg/executor/aggregate.(*HashAggPartialWorker).spillDataToDiskImpl
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggregate/agg_hash_partial_worker.go:362
github.com/pingcap/tidb/pkg/executor/aggregate.(*HashAggPartialWorker).spillDataToDisk
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggregate/agg_hash_partial_worker.go:316
github.com/pingcap/tidb/pkg/executor/aggregate.(*HashAggExec).spill.func1
	/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggregate/agg_hash_executor.go:544

Original message, but with the SQL statement redacted

[2025/06/13 13:01:16.438 +02:00] [ERROR] [agg_util.go:93] ["parallel hash aggregation panicked"] [error="runtime error: invalid memory address or nil pointer dereference"] [stack="github.com/pingcap/tidb/pkg/executor/aggregate.recoveryHashAgg\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggregate/agg_util.go:93\ngithub.com/pingcap/tidb/pkg/executor/aggregate.(*HashAggPartialWorker).spillDataToDiskImpl.func1\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggregate/agg_hash_partial_worker.go:330\nruntime.gopanic\n\t/go/pkg/mod/golang.org/[email protected]/src/runtime/panic.go:785\nruntime.panicmem\n\t/go/pkg/mod/golang.org/[email protected]/src/runtime/panic.go:262\nruntime.sigpanic\n\t/go/pkg/mod/golang.org/[email protected]/src/runtime/signal_unix.go:917\nbytes.(*Buffer).Bytes\n\t/go/pkg/mod/golang.org/[email protected]/src/bytes/buffer.go:54\ngithub.com/pingcap/tidb/pkg/util/serialization.SerializeBytesBuffer\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/util/serialization/serialization_util.go:171\ngithub.com/pingcap/tidb/pkg/executor/aggfuncs.(*SerializeHelper).serializeBasePartialResult4GroupConcat\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggfuncs/spill_serialize_helper.go:135\ngithub.com/pingcap/tidb/pkg/executor/aggfuncs.(*SerializeHelper).serializePartialResult4GroupConcat\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggfuncs/spill_serialize_helper.go:140\ngithub.com/pingcap/tidb/pkg/executor/aggfuncs.(*groupConcat).SerializePartialResult\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggfuncs/func_group_concat.go:180\ngithub.com/pingcap/tidb/pkg/executor/aggregate.(*HashAggPartialWorker).spillDataToDiskImpl\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggregate/agg_hash_partial_worker.go:362\ngithub.com/pingcap/tidb/pkg/executor/aggregate.(*HashAggPartialWorker).spillDataToDisk\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggregate/agg_hash_partial_worker.go:316\ngithub.com/pingcap/tidb/pkg/executor/aggregate.(*HashAggExec).spill.func1\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggregate/agg_hash_executor.go:544"]
[2025/06/13 13:01:17.151 +02:00] [INFO] [conn.go:1184] ["command dispatched failed"] [conn=3038773452] [session_alias=] [connInfo="id:3038773452, addr:10.10.62.11:9425 status:10, collation:utf8_general_ci, user:ibe"] [command=Query] [status="inTxn:0, autocommit:1"] [sql="explain analyze SELECT ..."] [txn_mode=PESSIMISTIC] [timestamp=458702705537056790] [err="runtime error: invalid memory address or nil pointer dereference\ngithub.com/pingcap/errors.Trace\n\t/go/pkg/mod/github.com/pingcap/[email protected]/juju_adaptor.go:15\ngithub.com/pingcap/tidb/pkg/util.GetRecoverError\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/util/util.go:288\ngithub.com/pingcap/tidb/pkg/executor/aggregate.recoveryHashAgg\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggregate/agg_util.go:91\ngithub.com/pingcap/tidb/pkg/executor/aggregate.(*HashAggPartialWorker).spillDataToDiskImpl.func1\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggregate/agg_hash_partial_worker.go:330\nruntime.gopanic\n\t/go/pkg/mod/golang.org/[email protected]/src/runtime/panic.go:785\nruntime.panicmem\n\t/go/pkg/mod/golang.org/[email protected]/src/runtime/panic.go:262\nruntime.sigpanic\n\t/go/pkg/mod/golang.org/[email protected]/src/runtime/signal_unix.go:917\nbytes.(*Buffer).Bytes\n\t/go/pkg/mod/golang.org/[email protected]/src/bytes/buffer.go:54\ngithub.com/pingcap/tidb/pkg/util/serialization.SerializeBytesBuffer\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/util/serialization/serialization_util.go:171\ngithub.com/pingcap/tidb/pkg/executor/aggfuncs.(*SerializeHelper).serializeBasePartialResult4GroupConcat\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggfuncs/spill_serialize_helper.go:135\ngithub.com/pingcap/tidb/pkg/executor/aggfuncs.(*SerializeHelper).serializePartialResult4GroupConcat\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggfuncs/spill_serialize_helper.go:140\ngithub.com/pingcap/tidb/pkg/executor/aggfuncs.(*groupConcat).SerializePartialResult\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggfuncs/func_group_concat.go:180\ngithub.com/pingcap/tidb/pkg/executor/aggregate.(*HashAggPartialWorker).spillDataToDiskImpl\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggregate/agg_hash_partial_worker.go:362\ngithub.com/pingcap/tidb/pkg/executor/aggregate.(*HashAggPartialWorker).spillDataToDisk\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggregate/agg_hash_partial_worker.go:316\ngithub.com/pingcap/tidb/pkg/executor/aggregate.(*HashAggExec).spill.func1\n\t/home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/executor/aggregate/agg_hash_executor.go:544\nruntime.goexit\n\t/go/pkg/mod/golang.org/[email protected]/src/runtime/asm_amd64.s:1700"]

4. What is your TiDB version? (Required)

v8.5.2

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions