Add Arbitration Post-Hearing Component with LLM-Based Entity Extraction by ramesh-katkuri · Pull Request #1938 · opea-project/GenAIComps

ramesh-katkuri · 2025-10-10T03:12:31Z

Description

Added a new Arbitration Post-Hearing component that integrates with vLLM and TGI server to interact with the LLM. This component automates post-hearing analysis by extracting key entities from transcripts, including case number, next hearing details, outcome, next scheduling time, and other relevant information. The integration ensures efficient LLM inference while providing structured, actionable insights to streamline the arbitration workflow.

Issues

List the issue or RFC link this PR is working on. If there is no such link, please mark it as n/a.

Type of change

List the type of change like below. Please delete options that are not relevant.

Bug fix (non-breaking change which fixes an issue)
New feature (non-breaking change which adds new functionality)
Breaking change (fix or feature that would break existing design and interface)
Others (enhancement, documentation, validation, etc.)

Dependencies

List the newly introduced 3rd party dependency if exists.

Tests

Describe the tests that you ran to verify your changes.

Flow Chat

for more information, see https://pre-commit.ci

codecov · 2025-10-10T03:15:54Z

Codecov Report

✅ All modified and coverable lines are covered by tests.

Files with missing lines	Coverage Δ
comps/cores/mega/constants.py	`97.43% <100.00%> (+0.03%)`	⬆️
comps/cores/proto/api_protocol.py	`92.30% <100.00%> (+0.07%)`	⬆️

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

tests/arb_post_hearing_assistant/test_abr_post_hearing_assistant_tgi.sh

ftian1 · 2025-10-10T05:07:50Z

@ramesh-katkuri The license header should be your company but not Intel？

comps/arb_post_hearing_assistant/deployment/docker_compose/compose.yaml

letonghan

Hi @ramesh-katkuri , thanks for your contributions. Please check the comments below, thanks.

comps/arb_post_hearing_assistant/deployment/docker_compose/compose.yaml

for more information, see https://pre-commit.ci

letonghan

LGTM

comps/arb_post_hearing_assistant/deployment/docker_compose/compose.yaml

…aymon@zensar.com>

Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com>

for more information, see https://pre-commit.ci

Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com>

…roject/GenAIComps into arb_posthearing_assistant

Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com>

for more information, see https://pre-commit.ci

…se.yaml in .github folder Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com>

…roject/GenAIComps into arb_posthearing_assistant

Signed-off-by: Ramesh <katkuri.ramesh@zensar.com>

…on (opea-project#1938) * initial commit for arbitratory micro service * test cases added * test cases added * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * renamed test file as per review comment * updated path of SCRIPT_DIR in to resolve microservice test * resolved comments wrt license header and env configs in compose file * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * removed unused MODEL env variable Signed-off-by: Author Name <c.noeljaymon@zensar.com> * removed space and added sign off Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * resolved ci issues for compose file name and readme reference paths Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com> * added arb_post_hearing_assistant-compose.yaml file in .github folder Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com> * deleted unused file redis-values.yaml Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * made service and image name same for arb_post_hearing_assistant-compose.yaml in .github folder Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com> * DCO remediation: adding missing Signed-off-by lines Signed-off-by: Ramesh <katkuri.ramesh@zensar.com> * fixed the micro service build issue Signed-off-by: Ramesh <katkuri.ramesh@zensar.com> * microservice container not found fixed Signed-off-by: Ramesh <katkuri.ramesh@zensar.com> * removed airgap code Signed-off-by: Ramesh <katkuri.ramesh@zensar.com> * fixed pre-commit check issue --------- Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com> Signed-off-by: Ramesh <katkuri.ramesh@zensar.com> Co-authored-by: Ramesh Katkuri <rameshkatkuri@Rameshs-MacBook-Air.local> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Noel Jaymon <c.noeljaymon@zensar.com> Signed-off-by: sunzhonghua2004 <137033036@qq.com>

…on (opea-project#1938) * initial commit for arbitratory micro service * test cases added * test cases added * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * renamed test file as per review comment * updated path of SCRIPT_DIR in to resolve microservice test * resolved comments wrt license header and env configs in compose file * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * removed unused MODEL env variable Signed-off-by: Author Name <c.noeljaymon@zensar.com> * removed space and added sign off Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * resolved ci issues for compose file name and readme reference paths Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com> * added arb_post_hearing_assistant-compose.yaml file in .github folder Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com> * deleted unused file redis-values.yaml Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * made service and image name same for arb_post_hearing_assistant-compose.yaml in .github folder Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com> * DCO remediation: adding missing Signed-off-by lines Signed-off-by: Ramesh <katkuri.ramesh@zensar.com> * fixed the micro service build issue Signed-off-by: Ramesh <katkuri.ramesh@zensar.com> * microservice container not found fixed Signed-off-by: Ramesh <katkuri.ramesh@zensar.com> * removed airgap code Signed-off-by: Ramesh <katkuri.ramesh@zensar.com> * fixed pre-commit check issue --------- Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com> Signed-off-by: Ramesh <katkuri.ramesh@zensar.com> Co-authored-by: Ramesh Katkuri <rameshkatkuri@Rameshs-MacBook-Air.local> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Noel Jaymon <c.noeljaymon@zensar.com> Signed-off-by: sunzhonghua2004 <jilong.wang@intel.com>

* Fix build issues (#1937) * Fix build issues Add docling in requirements.in Change pathway version to fix dependency conflict. Signed-off-by: ZePan110 <ze.pan@intel.com> --------- Signed-off-by: ZePan110 <ze.pan@intel.com> Signed-off-by: sunzhonghua2004 <jilong.wang@intel.com> * Add Arbitration Post-Hearing Component with LLM-Based Entity Extraction (#1938) * initial commit for arbitratory micro service * test cases added * test cases added * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * renamed test file as per review comment * updated path of SCRIPT_DIR in to resolve microservice test * resolved comments wrt license header and env configs in compose file * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * removed unused MODEL env variable Signed-off-by: Author Name <c.noeljaymon@zensar.com> * removed space and added sign off Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * resolved ci issues for compose file name and readme reference paths Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com> * added arb_post_hearing_assistant-compose.yaml file in .github folder Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com> * deleted unused file redis-values.yaml Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * made service and image name same for arb_post_hearing_assistant-compose.yaml in .github folder Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com> * DCO remediation: adding missing Signed-off-by lines Signed-off-by: Ramesh <katkuri.ramesh@zensar.com> * fixed the micro service build issue Signed-off-by: Ramesh <katkuri.ramesh@zensar.com> * microservice container not found fixed Signed-off-by: Ramesh <katkuri.ramesh@zensar.com> * removed airgap code Signed-off-by: Ramesh <katkuri.ramesh@zensar.com> * fixed pre-commit check issue --------- Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com> Signed-off-by: Ramesh <katkuri.ramesh@zensar.com> Co-authored-by: Ramesh Katkuri <rameshkatkuri@Rameshs-MacBook-Air.local> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Noel Jaymon <c.noeljaymon@zensar.com> Signed-off-by: sunzhonghua2004 <jilong.wang@intel.com> * add funasr paraformer asr service impl (#1914) * add funasr paraformer asr service impl * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix requirements deps; modify ASR READMEs * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * add funasr-paraformer dockerfile in github workflow --------- Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Signed-off-by: sunzhonghua2004 <jilong.wang@intel.com> * enable HF_TOKEN to be defined in request (#1940) Signed-off-by: wwanarif <wan.abdul.hakim.b.wan.arif@intel.com> Signed-off-by: sunzhonghua2004 <jilong.wang@intel.com> * fix the source of LibreOffice (#1942) Signed-off-by: zhihang <zhihangdeng@link.cuhk.edu.cn> Signed-off-by: sunzhonghua2004 <jilong.wang@intel.com> * Fix CD issue and llms build failure (#1943) * Fix permissions issue Signed-off-by: ZePan110 <ze.pan@intel.com> * Fix issue Signed-off-by: ZePan110 <ze.pan@intel.com> * Test Signed-off-by: ZePan110 <ze.pan@intel.com> * Revert "Test" This reverts commit 1df372c. --------- Signed-off-by: ZePan110 <ze.pan@intel.com> Signed-off-by: sunzhonghua2004 <jilong.wang@intel.com> * update vllm-ipex, boost servi performance (#1941) Signed-off-by: sunzhonghua2004 <jilong.wang@intel.com> * Add openGauss support to dataprep microservice and update related doc… (#1945) * add openGauss support for dataprep Signed-off-by: sunshuang1866 <sunshuang1866@outlook.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix the healthcheck for openGauss Signed-off-by: sunshuang1866 <sunshuang1866@outlook.com> * update README.md for openGauss Signed-off-by: sunshuang1866 <sunshuang1866@outlook.com> --------- Signed-off-by: sunshuang1866 <sunshuang1866@outlook.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Signed-off-by: sunzhonghua2004 <jilong.wang@intel.com> * Add openGauss support to retrievers and update related doc… (#1949) * add openGauss support for retrievers Signed-off-by: sunshuang1866 <sunshuang1866@outlook.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by: sunshuang1866 <sunshuang1866@outlook.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Signed-off-by: sunzhonghua2004 <jilong.wang@intel.com> * update package version to fit B60 Signed-off-by: sunzhonghua2004 <jilong.wang@intel.com> * enable CnClip B/16&L/14 and enable flickr30kcn dataset Signed-off-by: sunzhonghua2004 <jilong.wang@intel.com> * update docs about qwen2-vl &qwen2.5-vl & cnclip, add qwen-vl configs Signed-off-by: sunzhonghua2004 <jilong.wang@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci Signed-off-by: sunzhonghua2004 <jilong.wang@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci Signed-off-by: sunzhonghua2004 <jilong.wang@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * fix bug Signed-off-by: sunzhonghua2004 <jilong.wang@intel.com> * fix bug Signed-off-by: sunzhonghua2004 <jilong.wang@intel.com> * fix for doc Signed-off-by: sunzhonghua2004 <jilong.wang@intel.com> * fix gradio verion Signed-off-by: sunzhonghua2004 <jilong.wang@intel.com> * retrigger test Signed-off-by: sunzhonghua2004 <jilong.wang@intel.com> * added test for cnclip Signed-off-by: sunzhonghua2004 <jilong.wang@intel.com> --------- Signed-off-by: ZePan110 <ze.pan@intel.com> Signed-off-by: sunzhonghua2004 <jilong.wang@intel.com> Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com> Signed-off-by: Ramesh <katkuri.ramesh@zensar.com> Signed-off-by: wwanarif <wan.abdul.hakim.b.wan.arif@intel.com> Signed-off-by: zhihang <zhihangdeng@link.cuhk.edu.cn> Signed-off-by: sunshuang1866 <sunshuang1866@outlook.com> Co-authored-by: ZePan110 <ze.pan@intel.com> Co-authored-by: ramesh-katkuri <katkuri.ramesh@zensar.com> Co-authored-by: Ramesh Katkuri <rameshkatkuri@Rameshs-MacBook-Air.local> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Noel Jaymon <c.noeljaymon@zensar.com> Co-authored-by: LIU Lin <107393642+llin60@users.noreply.github.com> Co-authored-by: wanhakim <wanhakim92@gmail.com> Co-authored-by: zhihang <zhihangdeng@link.cuhk.edu.cn> Co-authored-by: linjiaojiao <jiaojiao.lin@intel.com> Co-authored-by: sunshuang1866 <sunshuang1866@outlook.com> Co-authored-by: Xueshu Wang <xueshu.wang@intel.com>

Ramesh Katkuri and others added 3 commits October 9, 2025 16:40

initial commit for arbitratory micro service

6a46ee3

test cases added

50fea93

test cases added

ecab3c0

ramesh-katkuri requested review from Spycsh, chensuyue, ftian1, letonghan, lkk12014402, lvliang-intel, minmin-intel and rbrugaro as code owners October 10, 2025 03:12

[pre-commit.ci] auto fixes from pre-commit.com hooks

83eefb8

for more information, see https://pre-commit.ci

joshuayao requested a review from yao531441 October 10, 2025 03:17

chensuyue reviewed Oct 10, 2025

View reviewed changes

tests/arb_post_hearing_assistant/test_abr_post_hearing_assistant_tgi.sh Show resolved Hide resolved

renamed test file as per review comment

367708f

yao531441 approved these changes Oct 10, 2025

View reviewed changes

comps/arb_post_hearing_assistant/deployment/docker_compose/compose.yaml Outdated Show resolved Hide resolved

letonghan reviewed Oct 10, 2025

View reviewed changes

comps/arb_post_hearing_assistant/deployment/docker_compose/compose.yaml Outdated Show resolved Hide resolved

comps/arb_post_hearing_assistant/deployment/docker_compose/compose.yaml Outdated Show resolved Hide resolved

cnoeljaymon and others added 4 commits October 10, 2025 12:12

pull of arb_posthearing_assistant branch in local

9597a60

updated path of SCRIPT_DIR in to resolve microservice test

431b813

resolved comments wrt license header and env configs in compose file

804cc36

[pre-commit.ci] auto fixes from pre-commit.com hooks

924abc6

for more information, see https://pre-commit.ci

letonghan approved these changes Oct 10, 2025

View reviewed changes

yao531441 approved these changes Oct 10, 2025

View reviewed changes

comps/arb_post_hearing_assistant/deployment/docker_compose/compose.yaml Outdated Show resolved Hide resolved

cnoeljaymon and others added 5 commits October 10, 2025 13:56

removed unused MODEL env variable Signed-off-by: Author Name <c.noelj…

6949d8c

…aymon@zensar.com>

removed space and added sign off

c3b6481

Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com>

resolve conflict

a00a110

Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com>

[pre-commit.ci] auto fixes from pre-commit.com hooks

e1070f0

for more information, see https://pre-commit.ci

resolved ci issues for compose file name and readme reference paths

3e9250b

Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com>

cnoeljaymon added 2 commits October 10, 2025 15:10

Merge branch 'arb_posthearing_assistant' of https://github.com/opea-p…

bbbdb4c

…roject/GenAIComps into arb_posthearing_assistant

added arb_post_hearing_assistant-compose.yaml file in .github folder

1fdb54c

Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com>

cnoeljaymon requested a review from ZePan110 as a code owner October 10, 2025 10:15

cnoeljaymon and others added 9 commits October 10, 2025 15:45

deleted unused file redis-values.yaml

b28aaa6

Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com>

[pre-commit.ci] auto fixes from pre-commit.com hooks

673b353

for more information, see https://pre-commit.ci

made service and image name same for arb_post_hearing_assistant-compo…

8bac045

…se.yaml in .github folder Signed-off-by: Noel Jaymon <c.noeljaymon@zensar.com>

Merge branch 'arb_posthearing_assistant' of https://github.com/opea-p…

e54b41f

…roject/GenAIComps into arb_posthearing_assistant

DCO remediation: adding missing Signed-off-by lines

8f43cf4

Signed-off-by: Ramesh <katkuri.ramesh@zensar.com>

fixed the micro service build issue

9003d56

Signed-off-by: Ramesh <katkuri.ramesh@zensar.com>

microservice container not found fixed

6f07014

Signed-off-by: Ramesh <katkuri.ramesh@zensar.com>

removed airgap code

1d0139b

Signed-off-by: Ramesh <katkuri.ramesh@zensar.com>

fixed pre-commit check issue

e7d7910

joshuayao merged commit caed793 into main Oct 10, 2025
26 checks passed

joshuayao deleted the arb_posthearing_assistant branch October 10, 2025 14:15

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add Arbitration Post-Hearing Component with LLM-Based Entity Extraction#1938

Add Arbitration Post-Hearing Component with LLM-Based Entity Extraction#1938
joshuayao merged 25 commits intomainfrom
arb_posthearing_assistant

ramesh-katkuri commented Oct 10, 2025

Uh oh!

codecov bot commented Oct 10, 2025 •

edited

Loading

Uh oh!

Uh oh!

ftian1 commented Oct 10, 2025

Uh oh!

Uh oh!

letonghan left a comment

Uh oh!

Uh oh!

Uh oh!

letonghan left a comment

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants

Conversation

ramesh-katkuri commented Oct 10, 2025

Description

Issues

Type of change

Dependencies

Tests

Flow Chat

Uh oh!

codecov bot commented Oct 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

Uh oh!

ftian1 commented Oct 10, 2025

Uh oh!

Uh oh!

letonghan left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

letonghan left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants

codecov bot commented Oct 10, 2025 •

edited

Loading