Skip to content

docs: NeMo Relay recipe for library-mode (libsy) integration#71

Draft
ryan-lempka wants to merge 7 commits into
mainfrom
rlempka/libsy-relay-integration
Draft

docs: NeMo Relay recipe for library-mode (libsy) integration#71
ryan-lempka wants to merge 7 commits into
mainfrom
rlempka/libsy-relay-integration

Conversation

@ryan-lempka

@ryan-lempka ryan-lempka commented Jul 15, 2026

Copy link
Copy Markdown
Collaborator

Summary

Adds the NeMo Relay recipe: running Switchyard as a library, with routing decisions made in-process by libsy inside NeMo Relay's Switchyard plugin. Complements the server-mode integration on topic/nemo-relay-integration.

  • docs/guides/nemo_relay.md — clean quickstart matching the existing Getting Started shape (Prerequisites → Install → Configure → Path A: Gateway → Path B: Agent launcher → Validate), with receipts showing routing happened.
  • docs/guides/nemo_relay_known_issues.md — what stands between the recipe and a fully routed interactive Claude Code session, with owners (libsy streaming, classifier-call 400, fail-open semantics, error opacity, toolchain).
  • examples/nemo_relay/{config.toml,plugins.toml} — copy-pasteable Relay configs (Haiku classifier routing Opus/Sonnet).

Relay-side implementation (the plugin's decision_backend = "libsy", tests, and the Path A e2e) lives on the reference branch: https://github.com/ryan-lempka/NeMo-Relay/tree/feat/libsy-decision-backend

Testing

  • Path A e2e verified from a fresh public checkout (hermetic deps): easy prompt routes weak, hard prompt routes strong, classifier + routed calls both through Relay dispatch.
  • Interactive Claude Code TUI session verified end to end; buffered calls produced real classifier decisions. Breaks are documented with evidence in the known-issues page.
  • mkdocs build --strict and the docs link lint pass.

@github-actions

github-actions Bot commented Jul 15, 2026

Copy link
Copy Markdown
PR Preview Action v1.8.1

🚀 View preview at
https://NVIDIA-NeMo.github.io/Switchyard/pr-preview/pr-71/

Built to branch gh-pages at 2026-07-15 18:34 UTC.
Preview will be ready when the GitHub Pages deployment is complete.

Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
@ryan-lempka ryan-lempka force-pushed the rlempka/libsy-relay-integration branch from 999970f to c7a9916 Compare July 15, 2026 17:34
@ryan-lempka ryan-lempka requested a review from messiaen July 15, 2026 18:10
… point

Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
…break demo

Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
… to examples

Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
…tracker

Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant