Skip to content

docs: update EPP protocol spec with streaming mode and health check requirements#2514

Open
Neha-dot-Yadav wants to merge 1 commit intokubernetes-sigs:mainfrom
Neha-dot-Yadav:update-epp-proposal
Open

docs: update EPP protocol spec with streaming mode and health check requirements#2514
Neha-dot-Yadav wants to merge 1 commit intokubernetes-sigs:mainfrom
Neha-dot-Yadav:update-epp-proposal

Conversation

@Neha-dot-Yadav
Copy link

What type of PR is this?

/kind documentation

What this PR does / why we need it:

This PR updates the Endpoint Picker Protocol (EPP) specification document to include two previously undocumented requirements:

  1. Streaming Mode Support: Documents that the EPP MUST support streaming mode for inference requests and responses, enabling full-duplex communication for real-time AI inference workloads.

  2. Health Checking: Documents the gRPC health checking protocol implementation, including:

    • Liveness checks (process health)
    • Readiness checks (service readiness)
    • External processor service checks
    • Leader election support for multi-replica deployments

These features are already implemented in the codebase (see cmd/epp/runner/health.go and pkg/epp/handlers/server.go) but were missing from the protocol specification document. This PR brings the documentation in sync with the actual implementation.

Which issue(s) this PR fixes:

Fixes #994

Does this PR introduce a user-facing change?:

Updated EPP protocol specification to document streaming mode and health checking requirements

@k8s-ci-robot k8s-ci-robot added the kind/documentation Categorizes issue or PR as related to documentation. label Mar 7, 2026
@netlify
Copy link

netlify bot commented Mar 7, 2026

Deploy Preview for gateway-api-inference-extension ready!

Name Link
🔨 Latest commit 0fc3b12
🔍 Latest deploy log https://app.netlify.com/projects/gateway-api-inference-extension/deploys/69ac5f97746e8800088194c0
😎 Deploy Preview https://deploy-preview-2514--gateway-api-inference-extension.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: Neha-dot-Yadav
Once this PR has been reviewed and has the lgtm label, please assign ahg-g for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot requested review from ahg-g and kfswain March 7, 2026 17:25
@k8s-ci-robot
Copy link
Contributor

Welcome @Neha-dot-Yadav!

It looks like this is your first PR to kubernetes-sigs/gateway-api-inference-extension 🎉. Please refer to our pull request process documentation to help your PR have a smooth ride to approval.

You will be prompted by a bot to use commands during the review process. Do not be afraid to follow the prompts! It is okay to experiment. Here is the bot commands documentation.

You can also check if kubernetes-sigs/gateway-api-inference-extension has its own contribution guidelines.

You may want to refer to our testing guide if you run into trouble with your tests not passing.

If you are having difficulty getting your pull request seen, please follow the recommended escalation practices. Also, for tips and tricks in the contribution process you may want to read the Kubernetes contributor cheat sheet. We want to make sure your contribution gets all the attention it needs!

Thank you, and welcome to Kubernetes. 😃

@k8s-ci-robot k8s-ci-robot added the needs-ok-to-test Indicates a PR that requires an org member to verify it is safe to test. label Mar 7, 2026
@k8s-ci-robot
Copy link
Contributor

Hi @Neha-dot-Yadav. Thanks for your PR.

I'm waiting for a kubernetes-sigs member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work.

Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@k8s-ci-robot k8s-ci-robot added size/M Denotes a PR that changes 30-99 lines, ignoring generated files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. labels Mar 7, 2026
@Neha-dot-Yadav
Copy link
Author

@ahg-g @kfswain
Could you please review when you have a moment? This updates the EPP protocol spec documentation to match the implementation.

@ahg-g
Copy link
Contributor

ahg-g commented Mar 14, 2026

/assign @danehans
/ok-to-test

@k8s-ci-robot k8s-ci-robot added ok-to-test Indicates a non-member PR verified by an org member that is safe to test. and removed needs-ok-to-test Indicates a PR that requires an org member to verify it is safe to test. labels Mar 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. kind/documentation Categorizes issue or PR as related to documentation. ok-to-test Indicates a non-member PR verified by an org member that is safe to test. size/M Denotes a PR that changes 30-99 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Update EPP Protocol Spec

4 participants