Skip to content

[fix](arrow-flight-sql) Separate arrow-flight-sql connection and mysql connection#50939

Merged
xinyiZzz merged 9 commits into
apache:masterfrom
xinyiZzz:20250512_fix_arrowflight_conn
May 19, 2025
Merged

[fix](arrow-flight-sql) Separate arrow-flight-sql connection and mysql connection#50939
xinyiZzz merged 9 commits into
apache:masterfrom
xinyiZzz:20250512_fix_arrowflight_conn

Conversation

@xinyiZzz

@xinyiZzz xinyiZzz commented May 15, 2025

Copy link
Copy Markdown
Contributor

What problem does this PR solve?

Add FE conf arrow_flight_max_connections as the upper limit of arrow-flight-sql connection, arrow-flight-sql connections and mysql connections will be managed separately.

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen

hello-stephen commented May 15, 2025

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@xinyiZzz

xinyiZzz commented May 15, 2025

Copy link
Copy Markdown
Contributor Author

run buildall

@doris-robot

doris-robot commented May 15, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 33576 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 840723567b9bbb4b0937aceb58a736c5e3678704, data reload: false

------ Round 1 ----------------------------------
q1	25942	5100	4923	4923
q2	2061	312	203	203
q3	10337	1276	702	702
q4	10237	1001	527	527
q5	7554	2402	2294	2294
q6	182	173	132	132
q7	917	743	611	611
q8	9332	1302	1032	1032
q9	6784	5045	5105	5045
q10	6861	2321	1888	1888
q11	502	282	269	269
q12	360	355	221	221
q13	17770	3738	3072	3072
q14	235	234	210	210
q15	537	475	503	475
q16	438	437	382	382
q17	617	856	383	383
q18	7429	7083	7118	7083
q19	1790	968	555	555
q20	352	327	229	229
q21	3958	2577	2391	2391
q22	1035	1007	949	949
Total cold run time: 115230 ms
Total hot run time: 33576 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5241	5108	5107	5107
q2	237	333	234	234
q3	2183	2752	2414	2414
q4	1444	1863	1372	1372
q5	4487	4399	4392	4392
q6	209	169	127	127
q7	1959	1911	1783	1783
q8	2590	2450	2519	2450
q9	7169	7194	6986	6986
q10	3038	3182	2773	2773
q11	617	525	480	480
q12	667	753	624	624
q13	3586	3897	3285	3285
q14	290	295	272	272
q15	516	492	489	489
q16	467	492	443	443
q17	1168	1595	1368	1368
q18	7630	7694	7344	7344
q19	815	811	860	811
q20	1955	2091	1846	1846
q21	4855	4485	4438	4438
q22	1084	1057	990	990
Total cold run time: 52207 ms
Total hot run time: 50028 ms

@doris-robot

doris-robot commented May 15, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 193218 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 840723567b9bbb4b0937aceb58a736c5e3678704, data reload: false

query1	1427	1093	1059	1059
query2	6170	1792	1781	1781
query3	11027	4648	4418	4418
query4	52613	25329	23591	23591
query5	5112	567	474	474
query6	330	207	197	197
query7	4906	511	291	291
query8	332	253	248	248
query9	5636	2627	2612	2612
query10	428	329	277	277
query11	15117	15031	14865	14865
query12	165	109	108	108
query13	1039	523	427	427
query14	10142	6454	6514	6454
query15	190	200	168	168
query16	7006	667	497	497
query17	1075	714	590	590
query18	1537	403	328	328
query19	196	186	175	175
query20	128	125	128	125
query21	206	122	114	114
query22	4217	4450	4394	4394
query23	34340	33445	33584	33445
query24	6614	2461	2441	2441
query25	489	505	443	443
query26	729	278	161	161
query27	2267	520	365	365
query28	3315	2153	2132	2132
query29	597	575	473	473
query30	285	230	202	202
query31	848	865	771	771
query32	81	66	71	66
query33	474	402	360	360
query34	776	865	552	552
query35	813	863	788	788
query36	975	1009	905	905
query37	123	99	87	87
query38	4272	4376	4229	4229
query39	1562	1478	1469	1469
query40	217	127	113	113
query41	60	55	51	51
query42	152	114	106	106
query43	517	527	488	488
query44	1363	824	829	824
query45	187	175	170	170
query46	847	1040	647	647
query47	1860	1845	1783	1783
query48	384	442	329	329
query49	683	535	452	452
query50	664	703	419	419
query51	4282	4275	4314	4275
query52	108	104	108	104
query53	231	266	197	197
query54	588	569	529	529
query55	90	88	84	84
query56	310	307	310	307
query57	1194	1180	1132	1132
query58	280	270	266	266
query59	2673	2747	2621	2621
query60	327	344	319	319
query61	130	121	124	121
query62	748	745	654	654
query63	232	193	193	193
query64	1734	1047	680	680
query65	4326	4271	4233	4233
query66	799	407	318	318
query67	15907	15716	15331	15331
query68	6850	897	522	522
query69	536	303	273	273
query70	1163	1114	1127	1114
query71	513	318	300	300
query72	5983	4843	4893	4843
query73	1453	692	346	346
query74	8959	9135	8662	8662
query75	3871	3199	2721	2721
query76	4242	1198	789	789
query77	653	369	278	278
query78	9982	10131	9382	9382
query79	2418	802	574	574
query80	637	517	449	449
query81	501	260	222	222
query82	443	129	98	98
query83	327	258	246	246
query84	295	106	87	87
query85	775	364	313	313
query86	381	317	282	282
query87	4492	4438	4339	4339
query88	3452	2289	2270	2270
query89	404	349	297	297
query90	1895	219	219	219
query91	160	159	122	122
query92	77	60	57	57
query93	1921	967	581	581
query94	660	414	306	306
query95	377	307	283	283
query96	499	576	280	280
query97	2755	2841	2630	2630
query98	237	217	203	203
query99	1449	1377	1302	1302
Total cold run time: 296812 ms
Total hot run time: 193218 ms

@doris-robot

doris-robot commented May 15, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 29 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 840723567b9bbb4b0937aceb58a736c5e3678704, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.10	0.12
query3	0.24	0.19	0.19
query4	1.60	0.19	0.19
query5	0.46	0.43	0.44
query6	1.49	0.66	0.66
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.58	0.51	0.50
query10	0.56	0.59	0.57
query11	0.15	0.11	0.11
query12	0.15	0.12	0.11
query13	0.62	0.60	0.61
query14	0.80	0.80	0.82
query15	0.89	0.86	0.88
query16	0.40	0.38	0.38
query17	1.08	1.05	1.04
query18	0.22	0.20	0.21
query19	1.97	1.88	1.78
query20	0.01	0.01	0.01
query21	15.39	0.96	0.55
query22	0.76	1.20	0.71
query23	14.83	1.39	0.58
query24	7.27	1.01	0.69
query25	0.49	0.30	0.07
query26	0.60	0.16	0.15
query27	0.04	0.05	0.05
query28	9.15	0.95	0.47
query29	12.56	4.10	3.38
query30	0.24	0.10	0.06
query31	2.81	0.63	0.39
query32	3.22	0.56	0.48
query33	3.13	3.07	3.14
query34	15.82	5.12	4.46
query35	4.49	4.47	4.51
query36	0.66	0.50	0.48
query37	0.09	0.07	0.07
query38	0.06	0.04	0.04
query39	0.03	0.02	0.02
query40	0.16	0.13	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.39 s
Total hot run time: 29 s

@yiguolei yiguolei added usercase Important user case type label dev/2.1.x dev/3.0.x labels May 15, 2025
yiguolei
yiguolei reviewed May 15, 2025
View reviewed changes
Comment thread fe/fe-common/src/main/java/org/apache/doris/common/Config.java Outdated
yiguolei
yiguolei reviewed May 15, 2025
View reviewed changes
Comment thread fe/fe-core/src/main/java/org/apache/doris/qe/ConnectSchedulerImpl.java Outdated
yiguolei
yiguolei reviewed May 15, 2025
View reviewed changes
Comment thread fe/fe-core/src/main/java/org/apache/doris/qe/ConnectScheduler.java Outdated
@hello-stephen

hello-stephen commented May 15, 2025

Copy link
Copy Markdown
Contributor

BE Regression && UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 58.78% (15439/26264)
Line Coverage 47.82% (141402/295689)
Region Coverage 44.88% (80072/178432)
Branch Coverage 38.45% (38997/101414)

@xinyiZzz

xinyiZzz commented May 15, 2025

Copy link
Copy Markdown
Contributor Author

run buildall

@doris-robot

doris-robot commented May 15, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 34545 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6932454073a6896bed2f683bc90c33480648e309, data reload: false

------ Round 1 ----------------------------------
q1	26344	5122	5055	5055
q2	2074	277	182	182
q3	10598	1215	696	696
q4	10250	1023	534	534
q5	7552	2341	2366	2341
q6	186	164	134	134
q7	928	769	613	613
q8	9327	1304	1146	1146
q9	7452	5214	5169	5169
q10	6900	2370	1930	1930
q11	501	284	278	278
q12	366	354	222	222
q13	20328	3749	3107	3107
q14	232	221	211	211
q15	535	478	508	478
q16	448	431	388	388
q17	599	865	359	359
q18	7830	7496	7411	7411
q19	1770	977	557	557
q20	324	347	214	214
q21	3952	3299	2482	2482
q22	1126	1079	1038	1038
Total cold run time: 119622 ms
Total hot run time: 34545 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5232	5227	5178	5178
q2	248	327	248	248
q3	2294	2887	2551	2551
q4	1548	1915	1484	1484
q5	4661	4413	4355	4355
q6	232	173	131	131
q7	2000	1932	1752	1752
q8	2638	2569	2489	2489
q9	7089	7097	6945	6945
q10	3018	3186	2776	2776
q11	577	514	502	502
q12	665	745	621	621
q13	3495	3960	3308	3308
q14	293	322	284	284
q15	517	478	473	473
q16	428	473	430	430
q17	1157	1519	1439	1439
q18	7695	7575	7372	7372
q19	832	821	874	821
q20	1953	2056	1861	1861
q21	4779	4516	4524	4516
q22	1117	1034	1033	1033
Total cold run time: 52468 ms
Total hot run time: 50569 ms

@doris-robot

doris-robot commented May 15, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 193187 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6932454073a6896bed2f683bc90c33480648e309, data reload: false

query1	1420	1091	1058	1058
query2	6469	1850	1848	1848
query3	11045	4608	4569	4569
query4	25717	23793	23087	23087
query5	4912	661	473	473
query6	311	211	208	208
query7	3998	499	288	288
query8	296	258	245	245
query9	8497	2594	2607	2594
query10	491	336	276	276
query11	15624	15660	14793	14793
query12	168	113	101	101
query13	1723	524	400	400
query14	10842	6182	6546	6182
query15	203	185	174	174
query16	7593	642	501	501
query17	1516	738	595	595
query18	2070	407	311	311
query19	196	184	172	172
query20	130	124	126	124
query21	206	124	109	109
query22	4355	4528	4368	4368
query23	34743	33745	33701	33701
query24	8198	2394	2411	2394
query25	516	466	392	392
query26	1008	279	158	158
query27	2730	523	357	357
query28	4810	2124	2100	2100
query29	655	580	447	447
query30	274	229	194	194
query31	923	893	814	814
query32	74	72	64	64
query33	548	423	339	339
query34	833	903	532	532
query35	821	901	761	761
query36	991	1006	899	899
query37	123	111	85	85
query38	4377	4361	4240	4240
query39	1533	1684	1470	1470
query40	226	127	110	110
query41	74	60	59	59
query42	121	108	110	108
query43	527	536	482	482
query44	1346	840	835	835
query45	188	212	166	166
query46	874	1040	645	645
query47	1864	1912	1828	1828
query48	414	436	323	323
query49	724	519	456	456
query50	693	705	414	414
query51	4303	4247	4419	4247
query52	121	112	112	112
query53	232	264	187	187
query54	598	591	524	524
query55	83	87	84	84
query56	320	343	296	296
query57	1158	1213	1134	1134
query58	265	267	268	267
query59	2670	2839	2687	2687
query60	334	327	307	307
query61	141	125	127	125
query62	799	728	698	698
query63	233	196	193	193
query64	4100	1052	715	715
query65	4437	4392	4354	4354
query66	936	401	362	362
query67	15915	15794	15740	15740
query68	9003	889	516	516
query69	490	309	266	266
query70	1204	1149	1105	1105
query71	491	317	307	307
query72	5639	4743	4867	4743
query73	721	616	348	348
query74	9369	9157	8747	8747
query75	4115	3221	2706	2706
query76	3793	1200	759	759
query77	792	378	279	279
query78	10031	10260	9273	9273
query79	2286	816	574	574
query80	640	496	449	449
query81	469	261	219	219
query82	425	127	97	97
query83	340	250	236	236
query84	280	105	87	87
query85	781	354	315	315
query86	342	301	297	297
query87	4529	4616	4422	4422
query88	3054	2261	2261	2261
query89	410	323	289	289
query90	1936	211	220	211
query91	147	141	111	111
query92	77	63	56	56
query93	1513	939	588	588
query94	672	433	319	319
query95	378	292	292	292
query96	493	577	286	286
query97	2724	2739	2663	2663
query98	254	209	200	200
query99	1476	1398	1285	1285
Total cold run time: 283509 ms
Total hot run time: 193187 ms

@doris-robot

doris-robot commented May 15, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 29.13 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6932454073a6896bed2f683bc90c33480648e309, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.11	0.12
query3	0.26	0.20	0.19
query4	1.59	0.19	0.19
query5	0.47	0.43	0.44
query6	1.17	0.67	0.66
query7	0.02	0.01	0.02
query8	0.04	0.03	0.03
query9	0.60	0.51	0.51
query10	0.56	0.59	0.57
query11	0.16	0.10	0.11
query12	0.15	0.11	0.11
query13	0.62	0.59	0.61
query14	0.80	0.81	0.82
query15	0.89	0.88	0.85
query16	0.40	0.41	0.39
query17	1.05	1.00	1.04
query18	0.22	0.20	0.21
query19	1.96	1.84	1.90
query20	0.02	0.02	0.02
query21	15.42	0.89	0.55
query22	0.75	1.22	0.60
query23	15.00	1.40	0.64
query24	7.18	0.83	1.02
query25	0.49	0.26	0.12
query26	0.67	0.18	0.16
query27	0.05	0.05	0.05
query28	9.27	0.93	0.44
query29	12.57	4.02	3.29
query30	0.26	0.10	0.07
query31	2.83	0.63	0.39
query32	3.24	0.56	0.46
query33	3.07	3.05	3.17
query34	15.87	5.11	4.52
query35	4.53	4.57	4.51
query36	0.68	0.50	0.48
query37	0.09	0.07	0.06
query38	0.05	0.05	0.03
query39	0.03	0.03	0.03
query40	0.18	0.13	0.13
query41	0.08	0.03	0.03
query42	0.04	0.02	0.03
query43	0.04	0.04	0.03
Total cold run time: 103.53 s
Total hot run time: 29.13 s

@doris-robot

doris-robot commented May 15, 2025

Copy link
Copy Markdown

BE UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 55.83% (14874/26640)
Line Coverage 44.63% (131799/295302)
Region Coverage 43.68% (66251/151671)
Branch Coverage 38.30% (33959/88656)

@xinyiZzz xinyiZzz force-pushed the 20250512_fix_arrowflight_conn branch from 6932454 to 07f2b2d Compare May 15, 2025 16:54
@xinyiZzz

xinyiZzz commented May 15, 2025

Copy link
Copy Markdown
Contributor Author

run buildall

@doris-robot

doris-robot commented May 15, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 33664 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 07f2b2d8b4d2b749475503c98c730d93a12b0d46, data reload: false

------ Round 1 ----------------------------------
q1	25798	5754	5021	5021
q2	2089	296	189	189
q3	10366	1230	692	692
q4	10233	980	518	518
q5	7755	2308	2311	2308
q6	185	167	141	141
q7	925	768	644	644
q8	9344	1198	972	972
q9	6834	5096	5055	5055
q10	6847	2312	1898	1898
q11	500	276	265	265
q12	350	349	210	210
q13	17795	3659	3139	3139
q14	251	226	219	219
q15	520	476	491	476
q16	423	434	368	368
q17	591	858	358	358
q18	7502	7260	7107	7107
q19	1511	925	544	544
q20	334	336	220	220
q21	4034	3148	2364	2364
q22	1033	989	956	956
Total cold run time: 115220 ms
Total hot run time: 33664 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5087	5075	5050	5050
q2	235	326	230	230
q3	2171	2613	2242	2242
q4	1400	1799	1392	1392
q5	4439	4353	4380	4353
q6	220	164	133	133
q7	2054	1992	1773	1773
q8	2607	2747	2569	2569
q9	7224	7188	6877	6877
q10	2985	3173	2782	2782
q11	567	517	502	502
q12	663	775	585	585
q13	3524	3847	3271	3271
q14	286	306	286	286
q15	540	496	474	474
q16	442	477	436	436
q17	1144	1514	1379	1379
q18	7583	7564	7498	7498
q19	798	773	881	773
q20	2020	2071	1842	1842
q21	4820	4479	4479	4479
q22	1077	1088	988	988
Total cold run time: 51886 ms
Total hot run time: 49914 ms

@doris-robot

doris-robot commented May 15, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 192556 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 07f2b2d8b4d2b749475503c98c730d93a12b0d46, data reload: false

query1	1381	1105	1024	1024
query2	6299	1864	1854	1854
query3	10997	4430	4582	4430
query4	56094	25141	23419	23419
query5	5013	519	464	464
query6	340	196	187	187
query7	4921	498	291	291
query8	320	257	243	243
query9	5862	2583	2605	2583
query10	441	324	259	259
query11	15067	15037	14807	14807
query12	160	113	107	107
query13	1066	534	415	415
query14	10252	6217	6259	6217
query15	205	206	190	190
query16	7109	667	480	480
query17	1090	766	595	595
query18	1535	421	342	342
query19	205	206	178	178
query20	130	123	125	123
query21	211	129	112	112
query22	4366	4321	4365	4321
query23	34337	33599	33725	33599
query24	6569	2441	2455	2441
query25	480	466	417	417
query26	737	268	161	161
query27	2385	505	337	337
query28	3465	2144	2132	2132
query29	581	564	430	430
query30	271	221	191	191
query31	838	862	798	798
query32	77	61	61	61
query33	457	354	314	314
query34	779	870	522	522
query35	783	848	770	770
query36	956	1018	918	918
query37	112	99	73	73
query38	4259	4335	4263	4263
query39	1498	1447	1464	1447
query40	219	121	108	108
query41	57	54	50	50
query42	131	107	103	103
query43	489	521	495	495
query44	1307	814	825	814
query45	180	179	171	171
query46	851	1028	643	643
query47	1865	1859	1801	1801
query48	397	447	323	323
query49	709	545	406	406
query50	675	684	408	408
query51	4165	4240	4189	4189
query52	103	107	96	96
query53	228	261	184	184
query54	586	580	528	528
query55	83	88	83	83
query56	309	305	297	297
query57	1176	1225	1124	1124
query58	267	261	260	260
query59	2748	2794	2754	2754
query60	332	358	305	305
query61	155	127	125	125
query62	745	752	693	693
query63	233	191	189	189
query64	1895	1034	664	664
query65	4293	4254	4229	4229
query66	737	411	297	297
query67	16278	15684	15522	15522
query68	7065	883	514	514
query69	545	309	275	275
query70	1167	1127	1091	1091
query71	492	327	299	299
query72	5542	4732	4695	4695
query73	1425	627	351	351
query74	9296	9158	8873	8873
query75	3869	3222	2679	2679
query76	4211	1185	750	750
query77	631	461	286	286
query78	10134	10232	9317	9317
query79	2458	813	560	560
query80	570	502	445	445
query81	482	259	212	212
query82	434	125	95	95
query83	359	262	234	234
query84	296	99	87	87
query85	787	355	360	355
query86	373	298	287	287
query87	4484	4500	4314	4314
query88	3607	2248	2232	2232
query89	406	319	282	282
query90	1806	204	203	203
query91	141	140	110	110
query92	68	59	61	59
query93	2139	952	585	585
query94	659	386	292	292
query95	362	292	290	290
query96	496	583	278	278
query97	2722	2777	2667	2667
query98	226	200	216	200
query99	1435	1384	1263	1263
Total cold run time: 301548 ms
Total hot run time: 192556 ms

@doris-robot

doris-robot commented May 15, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 29.15 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 07f2b2d8b4d2b749475503c98c730d93a12b0d46, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.11	0.12
query3	0.26	0.19	0.20
query4	1.62	0.20	0.11
query5	0.44	0.42	0.43
query6	1.17	0.66	0.67
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.58	0.51	0.51
query10	0.57	0.57	0.56
query11	0.15	0.11	0.11
query12	0.15	0.12	0.11
query13	0.62	0.61	0.60
query14	0.79	0.81	0.80
query15	0.89	0.85	0.84
query16	0.39	0.38	0.38
query17	1.08	1.04	1.04
query18	0.22	0.20	0.21
query19	1.92	1.76	1.82
query20	0.01	0.01	0.02
query21	15.40	0.93	0.53
query22	0.78	1.25	0.75
query23	14.78	1.38	0.61
query24	7.54	0.95	1.17
query25	0.52	0.14	0.07
query26	0.58	0.17	0.14
query27	0.06	0.05	0.05
query28	9.74	0.92	0.45
query29	12.57	3.94	3.29
query30	0.25	0.09	0.07
query31	2.82	0.61	0.38
query32	3.23	0.55	0.47
query33	3.03	3.07	3.10
query34	15.71	5.06	4.49
query35	4.55	4.54	4.55
query36	0.70	0.49	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.04	0.02	0.03
query40	0.17	0.13	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 103.84 s
Total hot run time: 29.15 s

wangbo
wangbo approved these changes May 19, 2025
View reviewed changes

@wangbo wangbo left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@xinyiZzz xinyiZzz merged commit 34e4bec into apache:master May 19, 2025
26 of 28 checks passed
xinyiZzz added a commit to xinyiZzz/incubator-doris that referenced this pull request May 21, 2025
@xinyiZzz
[fix](arrow-flight-sql) Separate arrow-flight-sql connection and mysq…
b622d6a 
…l connection (apache#50939)

Add FE conf `arrow_flight_max_connections` as the upper limit of
arrow-flight-sql connection, arrow-flight-sql connections and mysql
connections will be managed separately.
@xinyiZzz xinyiZzz mentioned this pull request May 21, 2025
Merged
16 tasks
@xinyiZzz xinyiZzz mentioned this pull request May 25, 2025
Merged
16 tasks
yiguolei pushed a commit that referenced this pull request May 26, 2025
@xinyiZzz
[fix](arrow) Rollback Arrow version 19.0.1 -> 17.0.0, Fix MacOS compi…
7eaed2e 
…le error and decimal type error when convert to Parquet (#51217)

### What problem does this PR solve?

Introduced: #50939

In Arrow 19.0.1, 

1. some scenarios will force the use of `arrow::smallest_decimal`
instead of `arrow::decimal`, but when `arrow::smallest_decimal` is
converted to Parquet, an error will occur: `NotImplemented: Unhandled
type for Arrow to Parquet schema conversion: decimal32(5, 2)`

2. when compile Doris BE on MacOS M1, an error `arithmetic on a pointer
to an incomplete type 'arrow::flight::FlightEndpoint'` will occur. This
is because there is a circular dependency in `arrow/flight/types.h`,
`std::vector<FlightEndpoint>` is used in `476: struct Data`, but `809:
struct FlightEndpoint` is defined later.
xinyiZzz added a commit to xinyiZzz/incubator-doris that referenced this pull request May 27, 2025
@xinyiZzz
[fix](arrow) Rollback Arrow version 19.0.1 -> 17.0.0, Fix MacOS compi…
7406b1a 
…le error and decimal type error when convert to Parquet (apache#51217)

Introduced: apache#50939

In Arrow 19.0.1,

1. some scenarios will force the use of `arrow::smallest_decimal`
instead of `arrow::decimal`, but when `arrow::smallest_decimal` is
converted to Parquet, an error will occur: `NotImplemented: Unhandled
type for Arrow to Parquet schema conversion: decimal32(5, 2)`

2. when compile Doris BE on MacOS M1, an error `arithmetic on a pointer
to an incomplete type 'arrow::flight::FlightEndpoint'` will occur. This
is because there is a circular dependency in `arrow/flight/types.h`,
`std::vector<FlightEndpoint>` is used in `476: struct Data`, but `809:
struct FlightEndpoint` is defined later.
xinyiZzz added a commit to xinyiZzz/incubator-doris that referenced this pull request May 27, 2025
@xinyiZzz
[fix](arrow) Rollback Arrow version 19.0.1 -> 17.0.0, Fix MacOS compi…
8c1dd14 
…le error and decimal type error when convert to Parquet (apache#51217)

Introduced: apache#50939

In Arrow 19.0.1,

1. some scenarios will force the use of `arrow::smallest_decimal`
instead of `arrow::decimal`, but when `arrow::smallest_decimal` is
converted to Parquet, an error will occur: `NotImplemented: Unhandled
type for Arrow to Parquet schema conversion: decimal32(5, 2)`

2. when compile Doris BE on MacOS M1, an error `arithmetic on a pointer
to an incomplete type 'arrow::flight::FlightEndpoint'` will occur. This
is because there is a circular dependency in `arrow/flight/types.h`,
`std::vector<FlightEndpoint>` is used in `476: struct Data`, but `809:
struct FlightEndpoint` is defined later.
xinyiZzz added a commit to xinyiZzz/incubator-doris that referenced this pull request May 27, 2025
@xinyiZzz
[fix](arrow-flight-sql) Separate arrow-flight-sql connection and mysq…
4619d13 
…l connection (apache#50939)

Add FE conf `arrow_flight_max_connections` as the upper limit of
arrow-flight-sql connection, arrow-flight-sql connections and mysql
connections will be managed separately.
@xinyiZzz xinyiZzz mentioned this pull request May 27, 2025
Merged
16 tasks
xinyiZzz added a commit to xinyiZzz/incubator-doris that referenced this pull request May 27, 2025
@xinyiZzz
[fix](arrow-flight-sql) Separate arrow-flight-sql connection and mysq…
173bd9a 
…l connection (apache#50939)

Add FE conf `arrow_flight_max_connections` as the upper limit of
arrow-flight-sql connection, arrow-flight-sql connections and mysql
connections will be managed separately.
koarz pushed a commit to koarz/doris that referenced this pull request Jun 4, 2025
@xinyiZzz
[fix](arrow-flight-sql) Separate arrow-flight-sql connection and mysq…
1d43315 
…l connection (apache#50939)

### What problem does this PR solve?

Add FE conf `arrow_flight_max_connections` as the upper limit of
arrow-flight-sql connection, arrow-flight-sql connections and mysql
connections will be managed separately.
koarz pushed a commit to koarz/doris that referenced this pull request Jun 4, 2025
@xinyiZzz
[fix](arrow) Rollback Arrow version 19.0.1 -> 17.0.0, Fix MacOS compi…
94adc4e 
…le error and decimal type error when convert to Parquet (apache#51217)

### What problem does this PR solve?

Introduced: apache#50939

In Arrow 19.0.1, 

1. some scenarios will force the use of `arrow::smallest_decimal`
instead of `arrow::decimal`, but when `arrow::smallest_decimal` is
converted to Parquet, an error will occur: `NotImplemented: Unhandled
type for Arrow to Parquet schema conversion: decimal32(5, 2)`

2. when compile Doris BE on MacOS M1, an error `arithmetic on a pointer
to an incomplete type 'arrow::flight::FlightEndpoint'` will occur. This
is because there is a circular dependency in `arrow/flight/types.h`,
`std::vector<FlightEndpoint>` is used in `476: struct Data`, but `809:
struct FlightEndpoint` is defined later.
dataroaring pushed a commit that referenced this pull request Jun 11, 2025
@xinyiZzz
branch-3.0: [fix](arrow-flight-sql) Separate arrow-flight-sql connect…
5bcaf5c 
…ion and mysql connection (#51294)

pick #50939
morrySnow added a commit to morrySnow/incubator-doris that referenced this pull request Jun 18, 2026
@morrySnow
[fix](process list) return unexpected result in FULL mode
4b04640 
2 issues:
- self fe check is not stable
- rpc privilege check should use ADMIN instead of GRANT

related PR: apache#25052 apache#50939
@morrySnow morrySnow mentioned this pull request Jun 18, 2026
Merged
16 tasks
morrySnow added a commit that referenced this pull request Jun 22, 2026
@morrySnow
[fix](process list) return unexpected result in FULL mode (#64631)
6d28423 
### What problem does this PR solve?

Related PR: #25052 #50939

Problem Summary:

2 issues:
- self fe check is not stable
- rpc privilege check should use ADMIN instead of GRANT
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@yiguolei yiguolei yiguolei approved these changes
@wangbo wangbo wangbo approved these changes
@CalvinKirs CalvinKirs CalvinKirs approved these changes
@morningman morningman Awaiting requested review from morningman morningman is a code owner

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.11-merged dev/3.0.7-merged dev/3.1.0-merged reviewed usercase Important user case type label

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

8 participants

@xinyiZzz @hello-stephen @doris-robot @yiguolei @wangbo @CalvinKirs @dataroaring @morrySnow