[enhancement](cloud) refine block file cache evict policy (#42451)

[freemandealer]

• Enhance cache performance and reduce cache misses by:
  • Prevent starvation of any particular cache.
  • Improve disk space utilization.
  • Maintain strict and systematic eviction priorities.
• Enhance the observability of caching strategies, allowing cache behavior to be intuitively self-explanatory through monitoring.
• Improve code comprehensibility: unify the cache framework to avoid ad-hoc handling of TTL, increasing the modularity of the code.
• Reduce operational complexity by eliminating and standardizing configuration items.

---

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Check List (For Committer)

• Test

  • Regression test
  • Unit Test
  • Manual test (add detailed scripts or steps below)
  • No need to test or manual test. Explain why:
    • This is a refactor/code format and no logic has been changed.
    • Previous test can cover this change.
    • No colde files have been changed.
    • Other reason

• Behavior changed:

  • No.
  • Yes.

• Does this need documentation?

  • No.
  • Yes.

• Release note

  None

Check List (For Reviewer who merge this PR)

• Confirm the release note
• Confirm test cases
• Confirm document
• Add branch pick label

[doris-robot]

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

[freemandealer]

run buildall

[freemandealer]

run buildall

[doris-robot]

TPC-H: Total hot run time: 40657 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 421dceec632aa77eda1e8664644932afa10654f9, data reload: false

------ Round 1 ----------------------------------
q1	17571	7331	7350	7331
q2	2048	158	147	147
q3	10766	1069	1169	1069
q4	10534	699	711	699
q5	7759	2850	2857	2850
q6	234	146	142	142
q7	1012	620	604	604
q8	9348	1920	2039	1920
q9	6595	6453	6518	6453
q10	6971	2261	2310	2261
q11	454	257	257	257
q12	415	214	205	205
q13	17761	2986	2967	2967
q14	258	212	206	206
q15	556	503	528	503
q16	653	597	604	597
q17	973	568	546	546
q18	7315	6562	6557	6557
q19	3980	1043	1128	1043
q20	481	199	206	199
q21	4249	3214	3090	3090
q22	1132	1011	1013	1011
Total cold run time: 111065 ms
Total hot run time: 40657 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7343	7238	7733	7238
q2	332	229	235	229
q3	3074	2909	2920	2909
q4	2069	1745	1705	1705
q5	5684	5733	5713	5713
q6	245	139	145	139
q7	2185	1707	1784	1707
q8	3375	3374	3441	3374
q9	8925	8898	8834	8834
q10	3528	3479	3536	3479
q11	586	487	499	487
q12	806	603	622	603
q13	16721	3114	3163	3114
q14	300	276	293	276
q15	570	512	525	512
q16	697	662	660	660
q17	1866	1605	1621	1605
q18	8141	7677	7528	7528
q19	2563	1599	1653	1599
q20	2053	1809	1862	1809
q21	5376	5230	5228	5228
q22	1122	1075	1048	1048
Total cold run time: 77561 ms
Total hot run time: 59796 ms

[doris-robot]

TPC-DS: Total hot run time: 194005 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 421dceec632aa77eda1e8664644932afa10654f9, data reload: false

query1	1226	943	905	905
query2	6238	2196	2116	2116
query3	10903	3954	3705	3705
query4	67062	30420	23452	23452
query5	5296	445	434	434
query6	402	180	179	179
query7	5652	319	302	302
query8	297	222	222	222
query9	8890	2625	2603	2603
query10	493	260	251	251
query11	17865	15210	15679	15210
query12	158	108	103	103
query13	1517	444	408	408
query14	10340	7206	6990	6990
query15	228	192	182	182
query16	7297	517	506	506
query17	1013	552	557	552
query18	1871	309	293	293
query19	191	157	153	153
query20	111	108	107	107
query21	208	102	101	101
query22	4510	4145	4177	4145
query23	34378	33587	33744	33587
query24	6052	2869	2854	2854
query25	531	403	393	393
query26	679	165	167	165
query27	1721	292	305	292
query28	4181	2507	2481	2481
query29	667	429	438	429
query30	235	159	150	150
query31	998	773	821	773
query32	63	54	56	54
query33	463	274	280	274
query34	898	504	499	499
query35	849	736	712	712
query36	1077	929	953	929
query37	115	71	74	71
query38	3930	3867	3875	3867
query39	1484	1420	1447	1420
query40	192	98	95	95
query41	51	50	47	47
query42	108	98	101	98
query43	529	492	504	492
query44	1107	776	804	776
query45	198	167	167	167
query46	1108	708	703	703
query47	1936	1821	1811	1811
query48	448	372	369	369
query49	745	409	399	399
query50	826	404	401	401
query51	7238	6986	6989	6986
query52	101	93	94	93
query53	251	181	182	181
query54	557	445	457	445
query55	78	77	79	77
query56	258	245	240	240
query57	1235	1112	1102	1102
query58	224	209	209	209
query59	3320	3104	2986	2986
query60	270	250	259	250
query61	125	99	111	99
query62	772	669	663	663
query63	209	193	179	179
query64	1728	625	578	578
query65	3281	3226	3189	3189
query66	733	307	304	304
query67	15670	15399	15332	15332
query68	4486	540	549	540
query69	420	251	267	251
query70	1152	1051	1119	1051
query71	357	261	255	255
query72	6407	3879	4039	3879
query73	760	338	337	337
query74	10265	8989	9034	8989
query75	3323	2663	2656	2656
query76	2174	866	1057	866
query77	486	260	256	256
query78	10590	9761	9529	9529
query79	8514	579	590	579
query80	1981	408	435	408
query81	553	238	245	238
query82	1240	119	117	117
query83	300	135	135	135
query84	284	79	71	71
query85	1401	305	277	277
query86	464	296	300	296
query87	4382	4133	4327	4133
query88	5668	2392	2395	2392
query89	536	296	285	285
query90	2098	180	180	180
query91	175	140	139	139
query92	58	45	45	45
query93	6511	536	541	536
query94	867	297	282	282
query95	347	244	254	244
query96	635	278	286	278
query97	3398	3132	3144	3132
query98	217	201	197	197
query99	1707	1292	1320	1292
Total cold run time: 335143 ms
Total hot run time: 194005 ms