PreCalculateScalar consumes a lot of CPU when non-lite init stats

[winoros]

Enhancement

After #52342 is fixed, we found another CPU consumer.
Too many small obj are allocated and causing too much GC pressure.

[winoros]

And it's also a possible issue when we load needed histograms.