Skip to content

branch-3.0: [bvar](cloud-mow) Add bvar for mow compaction get delete bitmap lock backoff sleep time (#52044) #52297

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: branch-3.0
Choose a base branch
from

Conversation

bobhan1
Copy link
Contributor

@bobhan1 bobhan1 commented Jun 25, 2025

pick #52044

@bobhan1 bobhan1 requested a review from dataroaring as a code owner June 25, 2025 08:51
@Thearas
Copy link
Contributor

Thearas commented Jun 25, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@bobhan1
Copy link
Contributor Author

bobhan1 commented Jun 25, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39709 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 742713d2350bc06c9a54a69cf2bbc4ffc12ce685, data reload: false

------ Round 1 ----------------------------------
q1	17578	6755	6587	6587
q2	2063	171	173	171
q3	10655	1063	1151	1063
q4	10518	745	753	745
q5	7735	2856	2851	2851
q6	212	133	132	132
q7	965	616	602	602
q8	9348	1955	2047	1955
q9	6599	6393	6451	6393
q10	6998	2264	2313	2264
q11	470	271	255	255
q12	392	216	216	216
q13	17788	2951	2973	2951
q14	232	206	207	206
q15	496	463	469	463
q16	489	390	386	386
q17	981	606	591	591
q18	7328	6596	6571	6571
q19	1390	1090	1011	1011
q20	475	206	200	200
q21	3826	3118	3269	3118
q22	1093	978	988	978
Total cold run time: 107631 ms
Total hot run time: 39709 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6588	6615	6668	6615
q2	324	229	233	229
q3	2897	2742	2830	2742
q4	2075	1765	1791	1765
q5	5813	5700	5771	5700
q6	219	131	126	126
q7	2220	1817	1781	1781
q8	3356	3520	3527	3520
q9	8907	8777	8901	8777
q10	3592	3541	3508	3508
q11	594	496	502	496
q12	782	603	585	585
q13	11279	3145	3188	3145
q14	296	257	282	257
q15	510	473	462	462
q16	487	433	440	433
q17	1846	1610	1593	1593
q18	8205	7781	7801	7781
q19	1719	1626	1693	1626
q20	2120	1795	1811	1795
q21	5103	4930	4978	4930
q22	1111	1054	1013	1013
Total cold run time: 70043 ms
Total hot run time: 58879 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196083 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 742713d2350bc06c9a54a69cf2bbc4ffc12ce685, data reload: false

query1	1266	924	921	921
query2	6232	1946	1955	1946
query3	10852	4406	4295	4295
query4	61172	34331	23844	23844
query5	5200	469	478	469
query6	326	177	170	170
query7	4901	320	317	317
query8	296	231	224	224
query9	6496	2559	2558	2558
query10	440	269	257	257
query11	15693	15423	15581	15423
query12	165	102	101	101
query13	1064	433	419	419
query14	10518	7139	7289	7139
query15	201	186	176	176
query16	7126	465	505	465
query17	1174	604	604	604
query18	1864	333	316	316
query19	215	164	164	164
query20	119	111	121	111
query21	206	100	104	100
query22	4735	4282	4584	4282
query23	34619	35141	34132	34132
query24	6225	2909	2888	2888
query25	544	431	420	420
query26	658	198	167	167
query27	1986	345	362	345
query28	3961	2142	2135	2135
query29	677	445	475	445
query30	231	157	155	155
query31	965	815	807	807
query32	66	56	55	55
query33	449	294	280	280
query34	916	491	534	491
query35	852	756	756	756
query36	1095	978	967	967
query37	110	67	71	67
query38	4098	4017	3982	3982
query39	1532	1491	1536	1491
query40	202	99	114	99
query41	50	48	48	48
query42	114	104	100	100
query43	555	513	503	503
query44	1186	818	794	794
query45	184	171	170	170
query46	1129	732	742	732
query47	2018	1911	1928	1911
query48	464	383	405	383
query49	743	389	398	389
query50	843	435	423	423
query51	7312	7312	7313	7312
query52	105	95	91	91
query53	259	188	188	188
query54	583	477	459	459
query55	75	78	78	78
query56	252	270	237	237
query57	1300	1206	1212	1206
query58	222	206	214	206
query59	3282	3118	3132	3118
query60	274	242	250	242
query61	105	105	111	105
query62	776	689	698	689
query63	217	186	184	184
query64	1355	663	629	629
query65	3278	3174	3183	3174
query66	702	295	301	295
query67	15990	15497	15552	15497
query68	3401	592	595	592
query69	424	256	287	256
query70	1220	1096	1152	1096
query71	382	255	243	243
query72	6081	2603	3870	2603
query73	766	347	349	347
query74	9807	8962	8965	8962
query75	3384	2641	2671	2641
query76	1725	988	1152	988
query77	528	277	280	277
query78	10589	9773	9524	9524
query79	1630	602	595	595
query80	851	425	442	425
query81	504	221	220	220
query82	1261	88	93	88
query83	248	140	145	140
query84	279	86	75	75
query85	890	303	297	297
query86	324	292	298	292
query87	4461	4310	4284	4284
query88	3939	2365	2357	2357
query89	418	288	303	288
query90	2020	183	184	183
query91	179	150	148	148
query92	62	50	50	50
query93	2284	544	543	543
query94	735	294	266	266
query95	357	268	254	254
query96	618	274	280	274
query97	3276	3136	3173	3136
query98	213	208	198	198
query99	1584	1319	1295	1295
Total cold run time: 307260 ms
Total hot run time: 196083 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.45 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 742713d2350bc06c9a54a69cf2bbc4ffc12ce685, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.02
query3	0.23	0.06	0.06
query4	1.63	0.10	0.10
query5	0.52	0.50	0.52
query6	1.14	0.74	0.73
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.55	0.50	0.50
query10	0.54	0.55	0.56
query11	0.15	0.10	0.10
query12	0.14	0.11	0.11
query13	0.61	0.60	0.60
query14	0.78	0.78	0.80
query15	0.85	0.84	0.83
query16	0.39	0.38	0.40
query17	1.00	0.97	1.07
query18	0.23	0.22	0.22
query19	1.93	1.90	1.89
query20	0.01	0.01	0.02
query21	15.43	0.60	0.56
query22	2.48	1.72	1.48
query23	17.38	0.91	0.83
query24	3.03	1.34	0.67
query25	0.17	0.26	0.11
query26	0.28	0.13	0.14
query27	0.05	0.05	0.04
query28	10.48	0.49	0.45
query29	12.59	3.28	3.27
query30	0.25	0.06	0.07
query31	2.85	0.40	0.38
query32	3.25	0.46	0.46
query33	2.94	2.94	3.04
query34	17.04	4.42	4.50
query35	4.54	4.52	4.44
query36	0.66	0.49	0.48
query37	0.08	0.07	0.06
query38	0.05	0.03	0.03
query39	0.03	0.02	0.02
query40	0.16	0.13	0.13
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 104.76 s
Total hot run time: 29.45 s

@bobhan1
Copy link
Contributor Author

bobhan1 commented Jun 25, 2025

run beut

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jun 26, 2025
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants