Skip to content

[opt](hive) unify the serde name of hive table#54189

Merged
morningman merged 1 commit into
apache:masterfrom
morningman:serde
Aug 4, 2025
Merged

[opt](hive) unify the serde name of hive table#54189
morningman merged 1 commit into
apache:masterfrom
morningman:serde

Conversation

@morningman

@morningman morningman commented Aug 1, 2025

Copy link
Copy Markdown
Contributor

No description provided.

@Thearas

Thearas commented Aug 1, 2025

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@morningman

morningman commented Aug 1, 2025

Copy link
Copy Markdown
Contributor Author

run buildall

@doris-robot

doris-robot commented Aug 1, 2025

Copy link
Copy Markdown
TPC-H: Total hot run time: 33960 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 59b5a81477ce4d2edfaf64b9fe6ff9d1f9b7985d, data reload: false

------ Round 1 ----------------------------------
q1	17726	5284	5319	5284
q2	1978	289	195	195
q3	10574	1395	785	785
q4	10309	1016	522	522
q5	9462	2390	2364	2364
q6	216	164	129	129
q7	894	776	611	611
q8	9315	1314	1043	1043
q9	6751	5359	5112	5112
q10	6894	2377	1972	1972
q11	484	278	256	256
q12	348	376	229	229
q13	17837	3447	2960	2960
q14	243	237	221	221
q15	511	468	477	468
q16	427	438	370	370
q17	563	823	350	350
q18	7408	7097	6992	6992
q19	2157	969	552	552
q20	335	322	214	214
q21	3496	3074	2317	2317
q22	1038	1069	1014	1014
Total cold run time: 108966 ms
Total hot run time: 33960 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5412	5483	5283	5283
q2	229	297	208	208
q3	2145	2558	2191	2191
q4	1337	1743	1306	1306
q5	4425	4501	4378	4378
q6	208	175	131	131
q7	2063	1914	1747	1747
q8	2506	2459	2520	2459
q9	7536	7707	7276	7276
q10	3417	3382	2951	2951
q11	531	501	485	485
q12	687	790	632	632
q13	3496	3682	3294	3294
q14	287	324	299	299
q15	509	455	467	455
q16	464	523	449	449
q17	1194	1464	1469	1464
q18	8078	7732	7572	7572
q19	14516	843	875	843
q20	2822	1921	1739	1739
q21	14669	4323	4199	4199
q22	1065	1061	968	968
Total cold run time: 77596 ms
Total hot run time: 50329 ms

@doris-robot

doris-robot commented Aug 1, 2025

Copy link
Copy Markdown
TPC-DS: Total hot run time: 160974 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 59b5a81477ce4d2edfaf64b9fe6ff9d1f9b7985d, data reload: false

reason	Doris	NULL	NULL	0	0	0	NULL	0	NULL	NULL	2023-12-26 22:43:56	2023-12-26 22:44:01	NULL	utf-8	NULL	NULL	
============================================
query1	1017	383	426	383
query2	6510	1708	1650	1650
query3	6764	229	223	223
query4	27623	23690	23114	23114
query5	4404	649	522	522
query6	338	248	237	237
query7	4635	520	292	292
query8	287	243	232	232
query9	8602	2950	2961	2950
query10	492	338	292	292
query11	15904	15242	14767	14767
query12	182	132	136	132
query13	1644	557	416	416
query14	8496	5717	5836	5717
query15	209	192	162	162
query16	7125	687	474	474
query17	1193	757	612	612
query18	2053	434	362	362
query19	218	210	181	181
query20	155	148	153	148
query21	223	125	107	107
query22	3998	3961	3929	3929
query23	34498	34340	34464	34340
query24	7957	2408	2391	2391
query25	593	507	441	441
query26	1224	287	158	158
query27	2718	499	346	346
query28	4370	2343	2343	2343
query29	826	614	523	523
query30	310	244	204	204
query31	889	793	704	704
query32	90	76	81	76
query33	587	422	410	410
query34	813	845	524	524
query35	812	858	772	772
query36	1017	1053	973	973
query37	137	110	91	91
query38	4044	3991	3958	3958
query39	1427	1358	1550	1358
query40	247	142	141	141
query41	68	62	60	60
query42	140	128	129	128
query43	526	497	493	493
query44	1480	895	884	884
query45	204	207	196	196
query46	968	1054	673	673
query47	1848	1845	1785	1785
query48	419	447	322	322
query49	742	525	441	441
query50	659	756	422	422
query51	4213	4248	4277	4248
query52	130	134	120	120
query53	264	290	211	211
query54	659	639	556	556
query55	92	84	88	84
query56	359	353	344	344
query57	1221	1216	1158	1158
query58	342	328	330	328
query59	2674	2738	2615	2615
query60	405	403	388	388
query61	177	127	146	127
query62	825	725	647	647
query63	252	216	212	212
query64	4410	1091	795	795
query65	4261	4129	4177	4129
query66	1160	459	335	335
query67	query68	17862	640	606	606
query69	1007	316	286	286
query70	1390	1140	1122	1122
query71	671	338	336	336
query72	9158	2268	2449	2268
query73	4410	648	355	355
query74	9000	8908	8473	8473
query75	6945	3110	2688	2688
query76	7999	1240	794	794
query77	1166	407	366	366
query78	query79	17017	624	597	597
query80	2720	594	530	530
query81	567	266	232	232
query82	977	148	118	118
query83	424	282	276	276
query84	298	101	89	89
query85	1800	403	332	332
query86	378	310	299	299
query87	4338	4277	4171	4171
query88	5646	2275	2291	2275
query89	525	376	322	322
query90	2618	234	228	228
query91	143	140	111	111
query92	89	70	67	67
query93	6984	1007	661	661
query94	1231	383	276	276
query95	410	332	315	315
query96	494	588	286	286
query97	2683	2750	2630	2630
query98	252	225	223	223
query99	1518	1348	1286	1286
Total cold run time: 303849 ms
Total hot run time: 160974 ms

@doris-robot

doris-robot commented Aug 1, 2025

Copy link
Copy Markdown
ClickBench: Total hot run time: 33.36 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 59b5a81477ce4d2edfaf64b9fe6ff9d1f9b7985d, data reload: false

query1	0.04	0.03	0.04
query2	0.07	0.04	0.04
query3	0.24	0.07	0.07
query4	1.61	0.11	0.10
query5	0.41	0.43	0.42
query6	1.19	0.67	0.67
query7	0.02	0.02	0.02
query8	0.05	0.04	0.03
query9	0.56	0.46	0.48
query10	0.55	0.52	0.52
query11	0.15	0.11	0.10
query12	0.15	0.12	0.11
query13	0.64	0.64	0.63
query14	0.94	1.14	1.00
query15	0.92	0.88	0.89
query16	0.38	0.40	0.38
query17	1.07	1.06	1.07
query18	0.23	0.20	0.19
query19	2.02	1.80	1.88
query20	0.02	0.01	0.02
query21	15.36	0.86	0.56
query22	0.79	1.22	0.64
query23	14.92	1.15	0.69
query24	5.88	2.18	1.06
query25	0.48	0.23	0.13
query26	0.62	0.16	0.14
query27	0.06	0.06	0.05
query28	9.68	0.86	0.44
query29	12.78	3.86	3.35
query30	3.09	3.09	2.98
query31	2.83	0.56	0.39
query32	3.25	0.57	0.50
query33	3.05	3.14	3.20
query34	16.02	5.28	4.96
query35	4.91	5.01	4.97
query36	0.71	0.52	0.49
query37	0.10	0.07	0.07
query38	0.06	0.05	0.04
query39	0.04	0.03	0.03
query40	0.18	0.14	0.13
query41	0.09	0.03	0.02
query42	0.04	0.03	0.03
query43	0.04	0.04	0.03
Total cold run time: 106.24 s
Total hot run time: 33.36 s

@github-actions

github-actions Bot commented Aug 4, 2025

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@github-actions github-actions Bot added the approved Indicates a PR has been approved by one committer. label Aug 4, 2025
@github-actions

github-actions Bot commented Aug 4, 2025

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@morningman morningman merged commit 01a2d35 into apache:master Aug 4, 2025
30 of 31 checks passed
github-actions Bot pushed a commit that referenced this pull request Aug 4, 2025
@morningman
[opt](hive) unify the serde name of hive table (#54189)
73d1dcd
@github-actions github-actions Bot mentioned this pull request Aug 4, 2025
Merged
morrySnow pushed a commit that referenced this pull request Aug 4, 2025
@github-actions @morningman
branch-3.1: [opt](hive) unify the serde name of hive table #54189 (#5…
e045bbf 
…4265)

Cherry-picked from #54189

Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@CalvinKirs CalvinKirs CalvinKirs approved these changes
@hubgeter hubgeter hubgeter approved these changes

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. dev/3.0.x dev/3.0.x-conflict dev/3.1.0-merged reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

6 participants

@morningman @Thearas @doris-robot @CalvinKirs @hubgeter @morrySnow