Skip to content

feat(nvca): nvsnap GPU checkpoint/restore integration#208

Draft
balajinvda wants to merge 1 commit into
mainfrom
feat/nvca-nvsnap-integration
Draft

feat(nvca): nvsnap GPU checkpoint/restore integration#208
balajinvda wants to merge 1 commit into
mainfrom
feat/nvca-nvsnap-integration

Conversation

@balajinvda

@balajinvda balajinvda commented Jul 16, 2026

Copy link
Copy Markdown
Contributor

Why

Brings the nvsnap GPU checkpoint/restore integration into the nvca operator, so NVCA-managed function pods can drive checkpoint capture and fast restore. Moved here from the (now frozen) GitLab repo as part of the GitHub cutover.

What changed

  • nvca operator drives nvsnap GPU checkpoint/restore: pkg/nvca/nvsnap (controller + reconciler), wired into the NVCAAgent reconcile path.
  • Serialized-herd cold start via pioneer election.
  • Operator Helm chart updates (deployment, values, network policy) + feature flag.
  • 60 files, ~+9k/-300.

How this was ported

github/main has a history disjoint from the old GitLab branch, so this is applied as a net-diff onto github/main (3-way merge), not a rebase. The GitLab CI config and the byoc featureflags docs are dropped (absent on GitHub / not applicable here).

Testing

  • go build ./... on the nvca module: green.
  • New nvsnap packages (pkg/nvca/nvsnap, .../controller, .../reconciler): tests pass.
  • No new test failures vs the github/main baseline (the pre-existing RBAC/network-policy golden-data test failures and the version-stamp init panic under plain go test reproduce identically on unmodified github/main; the module is normally tested via Bazel with version stamping).

Notes / follow-ups

  • Draft: leaving codegen (deepcopy/openapi) and gazelle BUILD regeneration to CI verification; the auto-merged generated files compile, will regenerate if CI flags staleness.
  • The dropped byoc featureflags doc can be re-added once its GitHub docs location is confirmed.
  • Depends on nvsnap agent images being available in the target registry for a live deploy.

Relates to #71

Port the nvsnap checkpoint/restore integration into the nvca operator
(re-port of GitLab !651 / closed !1748) onto post-cutover GitHub main.

- nvca operator drives nvsnap GPU checkpoint/restore (pkg/nvca/nvsnap:
  controller + reconciler), wired into NVCAAgent reconcile.
- serialized-herd cold start via pioneer election.
- operator chart (deployment/values/networkpolicy) + feature flag.

Applied as a net-diff onto github/main, whose history is disjoint from
GitLab. 60 files; the GitLab CI config and byoc featureflags docs are
dropped (absent on GitHub). Merge is clean: `go build ./...` is green,
the new nvsnap packages pass, and there are no new test failures versus
the github/main baseline.

Co-Authored-By: Balaji Ganesan <bganesan@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants