Skip to content

[Enhancement](inverted index) return OK instead of not supported in expr evaluate_inverted_index #41567 #41577

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Oct 9, 2024
Merged

[Enhancement](inverted index) return OK instead of not supported in expr evaluate_inverted_index #41567 #41577

merged 1 commit into from
Oct 9, 2024

Conversation

airborne12
Copy link
Member

cherry pick from #41567

@airborne12
Copy link
Member Author

run buildall

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@doris-robot
Copy link

TPC-H: Total hot run time: 40660 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0c51809203a153755c9182456a589db1df6caf51, data reload: false

------ Round 1 ----------------------------------
q1	17877	7497	7737	7497
q2	2609	154	159	154
q3	11796	1136	1169	1136
q4	10878	774	755	755
q5	7750	2926	2848	2848
q6	230	145	156	145
q7	998	665	629	629
q8	9751	1957	1967	1957
q9	6605	6457	6391	6391
q10	7056	2280	2280	2280
q11	445	245	246	245
q12	410	215	207	207
q13	17772	2974	2980	2974
q14	237	218	219	218
q15	552	519	501	501
q16	523	408	407	407
q17	999	524	629	524
q18	7282	6601	6706	6601
q19	1539	901	912	901
q20	575	278	274	274
q21	3809	3154	3038	3038
q22	1085	978	1004	978
Total cold run time: 110778 ms
Total hot run time: 40660 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7260	7214	7234	7214
q2	320	226	231	226
q3	2850	2734	2730	2730
q4	1883	1649	1685	1649
q5	5401	5426	5450	5426
q6	227	141	139	139
q7	2068	1676	1647	1647
q8	3198	3384	3399	3384
q9	8446	8451	8514	8451
q10	3428	3373	3374	3373
q11	579	474	468	468
q12	753	558	546	546
q13	16864	2963	2952	2952
q14	284	261	253	253
q15	550	527	497	497
q16	483	445	443	443
q17	1801	1561	1564	1561
q18	7560	7454	7291	7291
q19	1649	1455	1555	1455
q20	1979	1781	1772	1772
q21	5124	4973	5094	4973
q22	1075	1004	951	951
Total cold run time: 73782 ms
Total hot run time: 57401 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 188887 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0c51809203a153755c9182456a589db1df6caf51, data reload: false

query1	963	386	366	366
query2	6532	2011	1915	1915
query3	6701	217	218	217
query4	34205	23470	23362	23362
query5	4334	456	427	427
query6	250	162	161	161
query7	4625	312	293	293
query8	240	204	192	192
query9	9458	2667	2651	2651
query10	506	276	279	276
query11	18079	15211	15159	15159
query12	150	95	100	95
query13	1690	442	467	442
query14	9654	7143	6979	6979
query15	222	172	170	170
query16	7823	469	517	469
query17	1633	564	555	555
query18	1999	326	309	309
query19	200	154	147	147
query20	116	111	109	109
query21	216	103	99	99
query22	4673	4450	4158	4158
query23	34653	33785	33897	33785
query24	12126	2868	2785	2785
query25	722	403	412	403
query26	1790	161	166	161
query27	2853	307	289	289
query28	7973	2174	2148	2148
query29	1098	439	424	424
query30	318	155	151	151
query31	1004	786	835	786
query32	92	56	53	53
query33	765	292	295	292
query34	942	501	509	501
query35	895	759	717	717
query36	1123	923	939	923
query37	288	80	76	76
query38	4072	3927	3807	3807
query39	1486	1414	1414	1414
query40	291	105	98	98
query41	49	44	44	44
query42	124	92	101	92
query43	513	467	477	467
query44	1219	791	777	777
query45	200	163	169	163
query46	1137	695	683	683
query47	1913	1818	1806	1806
query48	450	344	336	336
query49	1275	387	385	385
query50	827	394	403	394
query51	7113	6968	7008	6968
query52	96	97	87	87
query53	259	185	184	184
query54	1275	461	461	461
query55	80	72	76	72
query56	273	252	257	252
query57	1230	1184	1143	1143
query58	254	233	229	229
query59	3021	2808	2927	2808
query60	311	276	298	276
query61	101	105	99	99
query62	862	678	662	662
query63	208	176	174	174
query64	5253	630	617	617
query65	3293	3167	3206	3167
query66	1433	310	299	299
query67	15817	15426	15241	15241
query68	4879	560	539	539
query69	509	285	282	282
query70	1185	1101	1090	1090
query71	414	278	260	260
query72	7321	4011	4050	4011
query73	776	334	342	334
query74	9692	8895	8942	8895
query75	3416	2636	2651	2636
query76	3455	876	925	876
query77	402	289	280	280
query78	10063	9227	9178	9178
query79	5243	568	571	568
query80	1954	434	430	430
query81	567	229	235	229
query82	919	134	131	131
query83	265	137	136	136
query84	302	84	75	75
query85	2189	297	285	285
query86	476	282	305	282
query87	4428	4263	4262	4262
query88	5313	2417	2401	2401
query89	420	282	284	282
query90	1987	180	179	179
query91	135	104	105	104
query92	59	48	43	43
query93	5357	541	511	511
query94	997	289	287	287
query95	345	242	247	242
query96	619	276	274	274
query97	3330	3079	3130	3079
query98	215	195	206	195
query99	1564	1261	1296	1261
Total cold run time: 314142 ms
Total hot run time: 188887 ms

@airborne12
[Enhancement](inverted index) return OK instead of not supported in e…
908d6cc 
…xpr evaluate_inverted_index (apache#41567)

## Proposed changes

Fix annoying error stack info
@airborne12 airborne12 force-pushed the pick_41567_to_origin_branch-3.0 branch from 0c51809 to 908d6cc Compare October 9, 2024 07:15
@airborne12
Copy link
Member Author

run buildall

@airborne12 airborne12 merged commit 2dda72d into apache:branch-3.0 Oct 9, 2024
15 of 24 checks passed
@airborne12 airborne12 deleted the pick_41567_to_origin_branch-3.0 branch October 9, 2024 07:54
@doris-robot
Copy link

TPC-H: Total hot run time: 40035 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 908d6cca2b4029d3acd97ae15063ec99d31e361d, data reload: false

------ Round 1 ----------------------------------
q1	17580	7423	7260	7260
q2	2048	155	151	151
q3	10723	1092	1181	1092
q4	10543	744	642	642
q5	7737	2783	2810	2783
q6	226	144	142	142
q7	977	619	598	598
q8	9575	1910	1921	1910
q9	8035	6416	6449	6416
q10	7016	2288	2296	2288
q11	436	241	239	239
q12	403	210	206	206
q13	17796	2994	2962	2962
q14	251	206	217	206
q15	546	511	515	511
q16	504	410	414	410
q17	971	526	534	526
q18	7189	6523	6747	6523
q19	1341	891	957	891
q20	568	270	265	265
q21	4149	3131	3039	3039
q22	1097	988	975	975
Total cold run time: 109711 ms
Total hot run time: 40035 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7225	7210	7171	7171
q2	328	230	233	230
q3	2882	2907	2854	2854
q4	2027	1728	1881	1728
q5	5715	5683	5697	5683
q6	221	139	138	138
q7	2209	1763	1769	1763
q8	3321	3507	3517	3507
q9	8721	8801	8788	8788
q10	3563	3533	3506	3506
q11	592	477	478	477
q12	812	617	607	607
q13	16231	3177	3102	3102
q14	309	287	268	268
q15	563	531	520	520
q16	531	466	451	451
q17	1847	1621	1605	1605
q18	8240	7813	7574	7574
q19	5431	1579	1357	1357
q20	2052	1880	1848	1848
q21	5452	5245	5273	5245
q22	1108	1016	1021	1016
Total cold run time: 79380 ms
Total hot run time: 59438 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193641 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 908d6cca2b4029d3acd97ae15063ec99d31e361d, data reload: false

query1	1232	880	869	869
query2	6261	1974	1950	1950
query3	10789	3998	3762	3762
query4	64855	29445	23375	23375
query5	5153	456	452	452
query6	391	167	181	167
query7	5450	322	305	305
query8	274	227	205	205
query9	8360	2653	2658	2653
query10	465	289	276	276
query11	17055	15127	15743	15127
query12	153	111	103	103
query13	1512	455	437	437
query14	10775	7125	7000	7000
query15	231	171	179	171
query16	7058	479	487	479
query17	1190	558	567	558
query18	1782	291	298	291
query19	200	143	140	140
query20	122	106	111	106
query21	202	107	102	102
query22	4596	4584	4820	4584
query23	34520	33823	33648	33648
query24	6025	2878	2792	2792
query25	479	371	378	371
query26	639	159	157	157
query27	1631	295	290	290
query28	4030	2172	2137	2137
query29	635	414	402	402
query30	223	141	144	141
query31	939	748	779	748
query32	66	50	48	48
query33	409	274	281	274
query34	883	502	497	497
query35	844	730	759	730
query36	1080	923	904	904
query37	129	80	69	69
query38	4002	3903	3919	3903
query39	1476	1427	1411	1411
query40	210	100	95	95
query41	44	43	43	43
query42	121	93	92	92
query43	499	476	471	471
query44	1088	780	775	775
query45	200	170	167	167
query46	1126	737	706	706
query47	1899	1821	1819	1819
query48	424	340	328	328
query49	677	390	392	390
query50	827	406	408	406
query51	6949	6895	6856	6856
query52	98	90	97	90
query53	253	182	184	182
query54	569	475	481	475
query55	78	77	70	70
query56	258	242	247	242
query57	1212	1165	1095	1095
query58	230	221	251	221
query59	3096	2802	2847	2802
query60	278	265	267	265
query61	101	100	98	98
query62	748	662	687	662
query63	209	174	178	174
query64	1319	597	591	591
query65	3296	3147	3178	3147
query66	598	304	301	301
query67	15551	15378	15360	15360
query68	2658	568	558	558
query69	591	287	281	281
query70	1152	1106	1101	1101
query71	403	264	274	264
query72	6732	4143	3875	3875
query73	753	337	334	334
query74	9894	8900	8933	8900
query75	3377	2670	2689	2670
query76	2621	935	1005	935
query77	633	282	286	282
query78	9804	9897	9580	9580
query79	2296	595	582	582
query80	1271	425	430	425
query81	518	217	219	217
query82	593	125	125	125
query83	280	131	137	131
query84	300	70	77	70
query85	1253	289	279	279
query86	431	287	300	287
query87	4380	4310	4354	4310
query88	3736	2365	2400	2365
query89	396	293	282	282
query90	2072	183	187	183
query91	139	100	102	100
query92	67	47	46	46
query93	2663	529	522	522
query94	1001	289	287	287
query95	358	252	252	252
query96	623	289	292	289
query97	3248	3122	3095	3095
query98	215	195	196	195
query99	1563	1272	1262	1262
Total cold run time: 314095 ms
Total hot run time: 193641 ms

@gavinchou gavinchou mentioned this pull request Nov 26, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@airborne12 @doris-robot