Skip to content

docs(embed/gcp): note memory-snapshot resume is unsupported on nested virt - #3761

Open
AdaAibaby wants to merge 1 commit into
e2b-dev:mainfrom
AdaAibaby:docs/embed-gcp-nested-virt-resume-limitation
Open

AdaAibaby wants to merge 1 commit into
e2b-dev:mainfrom
AdaAibaby:docs/embed-gcp-nested-virt-resume-limitation

Conversation

@AdaAibaby

Copy link
Copy Markdown
Contributor

Refs #3745.

Adds a Limitations on nested virtualization section to the GCP Embed module README: on GCE nested virt, cold boot works but memory-snapshot resume does not — the restored guest comes up with a dead virtio-net (vCPU + lazily-faulted memory fine, envd unreachable, sandbox marked stopping ~15s after create).

This documents a platform (nested KVM) limitation, not a runtime bug — confirmed in #3745 by the reporter running pristine upstream Firecracker v1.17.0 on the same instance, which exits the moment a VM is paused. Steers operators to the cold-boot path (filesystem_boot) or a bare-metal instance instead of chasing a resume that cannot work on nested virt.

… virt

GCE nested-virtualization VMs expose a KVM that cannot reliably restore
Firecracker device state, so memory-snapshot resume (the normal
POST /sandboxes path) yields a running guest whose virtio-net is dead: envd
is unreachable and the sandbox is marked stopping ~15s after create.
Cold boot (filesystem_boot) works on the same node because it initialises
devices from scratch rather than restoring them.

This is a platform (nested KVM) limitation, not a runtime bug — pristine
upstream Firecracker on the same GCE instance fails even earlier, exiting the
moment a VM is paused. Document it in the GCP module README so operators reach
for cold boot (or a bare-metal instance) instead of chasing a resume that
cannot work there.

Refs e2b-dev#3745.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants