Skip to content

Conversation

morningman
Copy link
Contributor

cherry pick from #41875

…ache#41875)

## Proposed changes

Impl BrotliBlockCompression to uncompressed brotli parquet data.
fix parquet case: group0/large_string_map.brotli.parquet
@morningman
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@doris-robot
Copy link

TPC-H: Total hot run time: 40151 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 01992356b7fabac7c29629f7177c0006ce95d8ac, data reload: false

------ Round 1 ----------------------------------
q1	17586	7328	7238	7238
q2	2051	154	144	144
q3	10737	1064	1092	1064
q4	10533	704	708	704
q5	7719	2795	2722	2722
q6	236	150	147	147
q7	1002	634	615	615
q8	9337	1894	1902	1894
q9	6564	6418	6307	6307
q10	6984	2259	2312	2259
q11	442	242	240	240
q12	424	221	214	214
q13	17779	2949	2951	2949
q14	255	220	210	210
q15	545	511	497	497
q16	656	607	594	594
q17	958	507	544	507
q18	7145	6612	6515	6515
q19	1876	1005	918	918
q20	585	283	270	270
q21	3891	3201	3166	3166
q22	1067	1007	977	977
Total cold run time: 108372 ms
Total hot run time: 40151 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7330	7246	7216	7216
q2	315	222	227	222
q3	2874	2821	2835	2821
q4	1977	1737	1769	1737
q5	5624	5662	5673	5662
q6	224	140	148	140
q7	2211	1767	1780	1767
q8	3321	3483	3502	3483
q9	8779	8892	8825	8825
q10	3518	3488	3500	3488
q11	572	494	498	494
q12	773	609	605	605
q13	16614	3166	3098	3098
q14	314	287	282	282
q15	558	524	506	506
q16	713	657	659	657
q17	1852	1616	1597	1597
q18	8114	7799	7411	7411
q19	2207	1460	1379	1379
q20	2131	1826	1837	1826
q21	5278	5171	5200	5171
q22	1117	1062	978	978
Total cold run time: 76416 ms
Total hot run time: 59365 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193577 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 01992356b7fabac7c29629f7177c0006ce95d8ac, data reload: false

query1	1255	927	893	893
query2	6250	2107	2086	2086
query3	10802	3815	3775	3775
query4	67140	28715	23329	23329
query5	5474	468	462	462
query6	455	162	167	162
query7	6143	312	303	303
query8	296	217	211	211
query9	9540	2672	2664	2664
query10	511	281	280	280
query11	18067	15168	15645	15168
query12	158	98	101	98
query13	1607	496	448	448
query14	11370	7325	7285	7285
query15	227	174	176	174
query16	7254	517	563	517
query17	1058	570	552	552
query18	1837	299	305	299
query19	193	148	149	148
query20	114	103	113	103
query21	211	103	106	103
query22	4534	4191	4322	4191
query23	34224	33888	33480	33480
query24	5725	2847	2869	2847
query25	518	416	399	399
query26	665	167	166	166
query27	1676	296	297	296
query28	4203	2507	2483	2483
query29	674	424	430	424
query30	233	155	155	155
query31	1005	794	796	794
query32	71	53	55	53
query33	469	293	293	293
query34	894	513	489	489
query35	869	735	743	735
query36	1046	951	939	939
query37	148	94	92	92
query38	3966	3889	3828	3828
query39	1482	1437	1427	1427
query40	197	100	100	100
query41	45	46	46	46
query42	116	101	95	95
query43	527	500	495	495
query44	1142	777	787	777
query45	203	168	164	164
query46	1121	705	712	705
query47	1948	1847	1867	1847
query48	456	364	348	348
query49	729	410	401	401
query50	832	422	443	422
query51	7346	6946	6767	6767
query52	107	89	95	89
query53	261	182	185	182
query54	592	458	479	458
query55	77	77	77	77
query56	270	250	242	242
query57	1202	1113	1102	1102
query58	215	231	228	228
query59	3274	3034	2869	2869
query60	281	261	265	261
query61	102	99	97	97
query62	773	672	662	662
query63	210	183	183	183
query64	1438	622	589	589
query65	3274	3156	3182	3156
query66	711	333	318	318
query67	15627	15354	15229	15229
query68	4377	528	555	528
query69	666	286	281	281
query70	1176	1138	1136	1136
query71	432	271	275	271
query72	7913	3831	3808	3808
query73	768	336	335	335
query74	10161	8878	8897	8878
query75	4332	2620	2641	2620
query76	3563	862	839	839
query77	767	287	283	283
query78	10014	9184	9259	9184
query79	6580	578	575	575
query80	1437	436	449	436
query81	580	244	238	238
query82	908	145	141	141
query83	393	135	137	135
query84	299	73	79	73
query85	1690	286	276	276
query86	457	292	291	291
query87	4432	4349	4254	4254
query88	5446	2384	2392	2384
query89	411	301	285	285
query90	2118	184	194	184
query91	138	104	106	104
query92	61	49	49	49
query93	5633	535	529	529
query94	1071	280	280	280
query95	341	246	246	246
query96	643	284	277	277
query97	3347	3140	3117	3117
query98	216	192	191	191
query99	1671	1289	1318	1289
Total cold run time: 337481 ms
Total hot run time: 193577 ms

@morningman morningman merged commit 78d38dd into apache:branch-3.0 Oct 21, 2024
20 of 24 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants