[LLM] add moe parallel groups

[SylarTiaNII]

PR types

New features

PR changes

Others

Description

add moe comm groups

[codecov]

Codecov Report

Attention: Patch coverage is 7.89474% with 35 lines in your changes missing coverage. Please review.

Project coverage is 17.38%. Comparing base (350acbf) to head (134bc27).
Report is 330 commits behind head on develop.

Files with missing lines	Patch %	Lines
paddlenlp/trainer/training_args.py	7.89%	35 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #9982      +/-   ##
===========================================
- Coverage    17.38%   17.38%   -0.01%     
===========================================
  Files          752      752              
  Lines       120317   120356      +39     
===========================================
+ Hits         20919    20922       +3     
- Misses       99398    99434      +36     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[wawltor]

LGTM