Skip to content

Conversation

qidaye
Copy link
Contributor

@qidaye qidaye commented Sep 6, 2024

bp #40314

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@qidaye qidaye force-pushed the pick_ignore_doc_value_2.0 branch from 8c7bca5 to 865dfd2 Compare September 6, 2024 03:15
@qidaye
Copy link
Contributor Author

qidaye commented Sep 6, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49011 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 865dfd25bb2d60feee5b7edd97b569bef1ce9620, data reload: false

------ Round 1 ----------------------------------
q1	17697	4395	4331	4331
q2	2106	157	148	148
q3	10259	1910	1912	1910
q4	10176	1240	1329	1240
q5	8482	3921	3900	3900
q6	228	125	120	120
q7	2073	1617	1631	1617
q8	9581	2747	2715	2715
q9	13621	9880	9675	9675
q10	8614	3554	3518	3518
q11	420	237	242	237
q12	462	294	288	288
q13	18350	3959	4010	3959
q14	363	322	316	316
q15	515	454	456	454
q16	529	453	465	453
q17	1141	967	952	952
q18	7226	6958	6866	6866
q19	1709	1600	1536	1536
q20	528	315	306	306
q21	4432	4084	4082	4082
q22	506	397	388	388
Total cold run time: 119018 ms
Total hot run time: 49011 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4292	4284	4284	4284
q2	325	228	221	221
q3	4155	4180	4101	4101
q4	2727	2734	2735	2734
q5	7099	7102	7071	7071
q6	236	119	117	117
q7	3229	2908	2820	2820
q8	4360	4502	4502	4502
q9	13652	13655	13512	13512
q10	4257	4307	4273	4273
q11	814	694	692	692
q12	1030	860	844	844
q13	6603	3752	3711	3711
q14	449	430	429	429
q15	498	468	467	467
q16	656	595	593	593
q17	3834	3843	3817	3817
q18	8840	8657	8815	8657
q19	1711	1703	1651	1651
q20	2402	2118	2131	2118
q21	8508	8405	8361	8361
q22	1021	948	944	944
Total cold run time: 80698 ms
Total hot run time: 75919 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 213482 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 865dfd25bb2d60feee5b7edd97b569bef1ce9620, data reload: false

query1	918	388	415	388
query2	6569	2181	2111	2111
query3	6928	202	206	202
query4	23277	21834	21718	21718
query5	19748	6491	6485	6485
query6	286	219	231	219
query7	4331	304	312	304
query8	259	266	273	266
query9	3063	2634	2557	2557
query10	464	321	308	308
query11	15858	14934	15002	14934
query12	126	78	72	72
query13	1021	451	444	444
query14	17735	13377	13631	13377
query15	369	214	226	214
query16	6492	274	262	262
query17	1925	945	906	906
query18	881	306	319	306
query19	211	150	151	150
query20	71	76	79	76
query21	190	96	98	96
query22	5223	4977	5033	4977
query23	34151	33415	33605	33415
query24	7600	6330	6305	6305
query25	544	422	419	419
query26	1257	164	157	157
query27	2282	295	287	287
query28	6140	2275	2221	2221
query29	2855	2720	2840	2720
query30	243	173	172	172
query31	951	728	763	728
query32	70	62	59	59
query33	458	267	268	267
query34	877	466	485	466
query35	1164	858	912	858
query36	1360	1136	1365	1136
query37	88	61	59	59
query38	3070	2923	2918	2918
query39	1401	1320	1348	1320
query40	308	97	96	96
query41	38	36	44	36
query42	85	94	81	81
query43	755	663	638	638
query44	1179	722	719	719
query45	240	228	227	227
query46	1229	961	961	961
query47	1899	1947	1873	1873
query48	506	414	405	405
query49	644	383	376	376
query50	863	621	636	621
query51	4776	4697	4610	4610
query52	95	79	86	79
query53	236	183	181	181
query54	2667	2454	2473	2454
query55	88	85	88	85
query56	225	217	214	214
query57	1206	1260	1179	1179
query58	218	201	212	201
query59	3422	3316	3305	3305
query60	216	201	215	201
query61	97	95	101	95
query62	824	492	459	459
query63	204	178	180	178
query64	3509	1592	1461	1461
query65	3650	3574	3561	3561
query66	776	408	432	408
query67	16240	15884	18111	15884
query68	8854	641	667	641
query69	516	276	273	273
query70	1740	1598	1615	1598
query71	404	306	309	306
query72	6763	4719	4892	4719
query73	782	314	315	314
query74	6237	5873	5860	5860
query75	4634	3862	3668	3668
query76	4551	1110	1122	1110
query77	556	248	255	248
query78	12588	11884	11708	11708
query79	8348	652	621	621
query80	1877	378	365	365
query81	505	238	240	238
query82	1543	97	100	97
query83	179	135	138	135
query84	265	69	69	69
query85	990	317	309	309
query86	326	290	286	286
query87	3218	3001	3029	3001
query88	4647	2304	2307	2304
query89	501	288	282	282
query90	1923	216	212	212
query91	172	128	126	126
query92	58	55	52	52
query93	6194	593	557	557
query94	779	208	213	208
query95	1989	2003	1969	1969
query96	647	325	332	325
query97	6512	6346	6410	6346
query98	225	196	206	196
query99	2971	872	901	872
Total cold run time: 318145 ms
Total hot run time: 213482 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.85 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 865dfd25bb2d60feee5b7edd97b569bef1ce9620, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.03
query3	0.25	0.05	0.05
query4	1.80	0.06	0.06
query5	0.53	0.52	0.52
query6	1.25	0.61	0.62
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.54	0.50	0.48
query10	0.53	0.53	0.53
query11	0.11	0.08	0.09
query12	0.11	0.10	0.09
query13	0.63	0.61	0.62
query14	0.78	0.81	0.78
query15	0.77	0.75	0.77
query16	0.37	0.36	0.36
query17	1.00	1.00	1.03
query18	0.22	0.27	0.24
query19	1.97	1.85	1.89
query20	0.01	0.01	0.01
query21	15.46	0.55	0.55
query22	1.85	1.63	2.41
query23	17.37	0.96	1.12
query24	4.86	2.92	1.94
query25	0.39	0.11	0.05
query26	0.82	0.15	0.16
query27	0.05	0.05	0.04
query28	5.49	0.76	0.79
query29	12.75	2.30	2.32
query30	0.57	0.55	0.53
query31	2.80	0.39	0.38
query32	3.42	0.50	0.50
query33	3.06	3.09	3.06
query34	15.25	4.78	4.77
query35	4.84	4.86	4.87
query36	1.06	1.02	1.02
query37	0.06	0.05	0.05
query38	0.03	0.02	0.02
query39	0.02	0.01	0.02
query40	0.17	0.14	0.14
query41	0.08	0.01	0.02
query42	0.02	0.02	0.01
query43	0.03	0.02	0.01
Total cold run time: 101.46 s
Total hot run time: 31.85 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 865dfd25bb2d60feee5b7edd97b569bef1ce9620 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.1 seconds inserted 10000000 Rows, about 473K ops/s

@morningman morningman merged commit 2b568b3 into apache:branch-2.0 Sep 6, 2024
21 of 23 checks passed
@qidaye qidaye deleted the pick_ignore_doc_value_2.0 branch September 6, 2024 08:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants