Skip to content

docs: NeMo Relay recipe for library-mode (libsy) integration#71

Draft
ryan-lempka wants to merge 12 commits into
mainfrom
rlempka/libsy-relay-integration
Draft

docs: NeMo Relay recipe for library-mode (libsy) integration#71
ryan-lempka wants to merge 12 commits into
mainfrom
rlempka/libsy-relay-integration

Conversation

@ryan-lempka

@ryan-lempka ryan-lempka commented Jul 15, 2026

Copy link
Copy Markdown
Collaborator

Summary

Adds the NeMo Relay recipe: running Switchyard as a library, with routing decisions made in-process by libsy inside NeMo Relay's Switchyard plugin. Customer-facing quickstart matching the existing Getting Started shape (Prerequisites → Install → Configure → Path A: Gateway → Path B: Agent launcher → Validate), using OpenRouter's Anthropic-compatible endpoint for targets.

  • docs/guides/nemo_relay.md — the quickstart, with receipts for validating that routing happened.
  • examples/nemo_relay/{config.toml,plugins.toml} — copy-pasteable Relay configs (random routing between strong/weak targets, per the current drop scope).

Relay-side implementation lives on the reference branch (built on Relay 0.7 main against Switchyard 93f0e3ea with streaming): https://github.com/ryan-lempka/NeMo-Relay/tree/feat/libsy-decision-backend

Testing

  • Path A e2e green, including streamed routing: easy prompt routes weak, hard prompt routes strong buffered AND streamed.
  • Path B verified interactively: Claude Code TUI session with libsy routing decisions on streamed calls, responses served by both targets.
  • mkdocs build --strict and the docs link lint pass.

@github-actions

github-actions Bot commented Jul 15, 2026

Copy link
Copy Markdown
PR Preview Action v1.8.1

🚀 View preview at
https://NVIDIA-NeMo.github.io/Switchyard/pr-preview/pr-71/

Built to branch gh-pages at 2026-07-17 19:22 UTC.
Preview will be ready when the GitHub Pages deployment is complete.

@ryan-lempka
ryan-lempka force-pushed the rlempka/libsy-relay-integration branch from 999970f to c7a9916 Compare July 15, 2026 17:34
@ryan-lempka
ryan-lempka requested a review from messiaen July 15, 2026 18:10
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
… point

Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
…break demo

Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
… to examples

Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
…tracker

Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
…en precedent

Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
@ryan-lempka
ryan-lempka force-pushed the rlempka/libsy-relay-integration branch from 1e7b5b4 to ee3d051 Compare July 17, 2026 19:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant