Skip to content

[world] Bump specVersion to 4, disable incompatible community worlds#1682

Closed
VaguelySerious wants to merge 1 commit intomainfrom
peter/spec-version-4
Closed

[world] Bump specVersion to 4, disable incompatible community worlds#1682
VaguelySerious wants to merge 1 commit intomainfrom
peter/spec-version-4

Conversation

@VaguelySerious
Copy link
Copy Markdown
Member

Summary

  • Adds SPEC_VERSION_SUPPORTS_RESTRUCTURED_WORLD = 4 and bumps SPEC_VERSION_CURRENT to 4
  • Updates world-vercel to declare the new spec version
  • Adds specVersion field to community world entries in worlds-manifest.json (set to 3)
  • Filters community worlds in CI matrix generation when their specVersion doesn't match SPEC_VERSION_CURRENT
  • Handles empty matrix gracefully in both tests.yml and benchmarks.yml

Recent interface changes (restructured streams requiring run IDs, async getWorld) break community worlds built against the v3 interface. Rather than letting them fail in CI, this skips them until they're updated to implement the v4 interface.

Test plan

  • pnpm typecheck passes (41/41 tasks)
  • start.test.ts passes (20/20 tests)
  • Matrix script correctly filters out specVersion 3 worlds
  • Verify CI skips community world jobs when matrix is empty
  • Verify e2e-required-check passes with skipped community worlds

🤖 Generated with Claude Code

…in CI

Recent interface changes (restructured streams, async getWorld) break
community worlds built against spec version 3. This bumps
SPEC_VERSION_CURRENT to 4 and filters community worlds in CI based on
the specVersion declared in worlds-manifest.json.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@vercel
Copy link
Copy Markdown
Contributor

vercel bot commented Apr 10, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
example-nextjs-workflow-turbopack Ready Ready Preview, Comment Apr 10, 2026 4:51am
example-nextjs-workflow-webpack Ready Ready Preview, Comment Apr 10, 2026 4:51am
example-workflow Ready Ready Preview, Comment Apr 10, 2026 4:51am
workbench-astro-workflow Ready Ready Preview, Comment Apr 10, 2026 4:51am
workbench-express-workflow Ready Ready Preview, Comment Apr 10, 2026 4:51am
workbench-fastify-workflow Ready Ready Preview, Comment Apr 10, 2026 4:51am
workbench-hono-workflow Ready Ready Preview, Comment Apr 10, 2026 4:51am
workbench-nitro-workflow Ready Ready Preview, Comment Apr 10, 2026 4:51am
workbench-nuxt-workflow Ready Ready Preview, Comment Apr 10, 2026 4:51am
workbench-sveltekit-workflow Ready Ready Preview, Comment Apr 10, 2026 4:51am
workbench-vite-workflow Ready Ready Preview, Comment Apr 10, 2026 4:51am
workflow-docs Ready Ready Preview, Comment, Open in v0 Apr 10, 2026 4:51am
workflow-swc-playground Ready Ready Preview, Comment Apr 10, 2026 4:51am

@VaguelySerious VaguelySerious requested a review from a team as a code owner April 10, 2026 04:49
@changeset-bot
Copy link
Copy Markdown

changeset-bot bot commented Apr 10, 2026

🦋 Changeset detected

Latest commit: 7d1f207

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 20 packages
Name Type
@workflow/world Minor
@workflow/world-vercel Minor
@workflow/cli Patch
@workflow/core Patch
@workflow/vitest Patch
@workflow/web-shared Patch
@workflow/world-local Patch
@workflow/world-postgres Patch
@workflow/world-testing Patch
workflow Patch
@workflow/builders Patch
@workflow/next Patch
@workflow/nitro Patch
@workflow/ai Patch
@workflow/astro Patch
@workflow/nest Patch
@workflow/rollup Patch
@workflow/sveltekit Patch
@workflow/vite Patch
@workflow/nuxt Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 0.043s (+1.6%) 1.006s (~) 0.962s 10 1.00x
💻 Local Nitro 0.044s (+18.9% 🔺) 1.005s (~) 0.961s 10 1.01x
🐘 Postgres Next.js (Turbopack) 0.059s 1.010s 0.950s 10 1.36x
🐘 Postgres Express 0.061s (-8.4% 🟢) 1.009s (~) 0.948s 10 1.40x
🐘 Postgres Nitro 0.061s (-2.9%) 1.010s (~) 0.949s 10 1.41x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 0.265s (-40.3% 🟢) 2.108s (-5.2% 🟢) 1.842s 10 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 1 step

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 1.126s (~) 2.006s (~) 0.880s 10 1.00x
💻 Local Nitro 1.126s (+2.2%) 2.005s (~) 0.879s 10 1.00x
🐘 Postgres Next.js (Turbopack) 1.141s 2.009s 0.868s 10 1.01x
🐘 Postgres Express 1.142s (~) 2.010s (~) 0.868s 10 1.01x
🐘 Postgres Nitro 1.157s (+0.5%) 2.010s (~) 0.853s 10 1.03x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 1.827s (-11.8% 🟢) 3.744s (+1.4%) 1.917s 10 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 10.816s 11.020s 0.204s 3 1.00x
🐘 Postgres Express 10.891s (~) 11.019s (~) 0.128s 3 1.01x
💻 Local Nitro 10.924s (+2.4%) 11.023s (~) 0.099s 3 1.01x
💻 Local Express 10.927s (~) 11.023s (~) 0.096s 3 1.01x
🐘 Postgres Nitro 10.945s (+0.8%) 11.024s (~) 0.078s 3 1.01x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 19.348s (+8.9% 🔺) 21.334s (+12.6% 🔺) 1.987s 2 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 14.427s 15.021s 0.594s 4 1.00x
🐘 Postgres Express 14.546s (~) 15.022s (~) 0.476s 4 1.01x
🐘 Postgres Nitro 14.674s (+1.2%) 15.028s (~) 0.354s 4 1.02x
💻 Local Express 14.960s (-0.6%) 15.028s (-6.3% 🟢) 0.069s 4 1.04x
💻 Local Nitro 15.005s (+5.5% 🔺) 15.279s (+1.7%) 0.274s 4 1.04x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 30.477s (-10.2% 🟢) 33.080s (-8.0% 🟢) 2.603s 2 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 13.730s 14.023s 0.293s 7 1.00x
🐘 Postgres Express 14.106s (~) 14.876s (+0.9%) 0.770s 7 1.03x
🐘 Postgres Nitro 14.376s (+3.7%) 15.027s (+7.2% 🔺) 0.650s 6 1.05x
💻 Local Express 16.677s (-1.5%) 17.031s (~) 0.354s 6 1.21x
💻 Local Nitro 16.750s (+12.3% 🔺) 17.032s (+13.3% 🔺) 0.281s 6 1.22x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 51.140s (-6.6% 🟢) 52.804s (-7.4% 🟢) 1.664s 2 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 1.235s 2.010s 0.775s 15 1.00x
🐘 Postgres Express 1.265s (-0.6%) 2.010s (~) 0.745s 15 1.02x
🐘 Postgres Nitro 1.285s (+1.5%) 2.010s (~) 0.725s 15 1.04x
💻 Local Express 1.511s (-1.1%) 2.006s (~) 0.495s 15 1.22x
💻 Local Nitro 1.546s (+3.4%) 2.006s (~) 0.460s 15 1.25x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 2.699s (+13.6% 🔺) 4.331s (+12.0% 🔺) 1.632s 7 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 2.322s (~) 3.009s (~) 0.686s 10 1.00x
🐘 Postgres Nitro 2.371s (~) 3.009s (~) 0.638s 10 1.02x
🐘 Postgres Next.js (Turbopack) 2.371s 3.009s 0.638s 10 1.02x
💻 Local Express 2.912s (-8.5% 🟢) 3.342s (-16.7% 🟢) 0.430s 9 1.25x
💻 Local Nitro 2.995s (+9.8% 🔺) 3.676s (+14.6% 🔺) 0.681s 9 1.29x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 2.623s (-13.2% 🟢) 4.183s (-5.0% 🟢) 1.560s 8 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 3.447s (-1.6%) 4.011s (~) 0.563s 8 1.00x
🐘 Postgres Nitro 3.498s (~) 4.011s (~) 0.513s 8 1.01x
🐘 Postgres Next.js (Turbopack) 3.657s 4.013s 0.356s 8 1.06x
💻 Local Express 8.092s (-3.1%) 9.023s (~) 0.931s 4 2.35x
💻 Local Nitro 8.506s (+9.8% 🔺) 9.022s (+5.9% 🔺) 0.517s 4 2.47x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 3.528s (+16.2% 🔺) 5.650s (+22.6% 🔺) 2.122s 6 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 1.226s 2.009s 0.783s 15 1.00x
🐘 Postgres Express 1.260s (-2.7%) 2.009s (~) 0.748s 15 1.03x
🐘 Postgres Nitro 1.274s (+1.2%) 2.009s (~) 0.735s 15 1.04x
💻 Local Express 1.533s (-2.0%) 2.007s (~) 0.474s 15 1.25x
💻 Local Nitro 1.596s (+6.0% 🔺) 2.006s (~) 0.410s 15 1.30x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 2.525s (+16.5% 🔺) 4.385s (+22.5% 🔺) 1.860s 7 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

Promise.race with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 2.334s (-1.9%) 3.009s (~) 0.675s 10 1.00x
🐘 Postgres Nitro 2.345s (~) 3.010s (~) 0.665s 10 1.00x
🐘 Postgres Next.js (Turbopack) 2.381s 3.009s 0.627s 10 1.02x
💻 Local Express 2.988s (-5.7% 🟢) 3.565s (-8.2% 🟢) 0.577s 9 1.28x
💻 Local Nitro 3.106s (-11.2% 🟢) 3.887s (-3.1%) 0.781s 8 1.33x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 2.775s (+11.9% 🔺) 4.686s (+21.1% 🔺) 1.912s 7 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 3.447s (-1.2%) 4.010s (~) 0.562s 8 1.00x
🐘 Postgres Nitro 3.512s (+1.3%) 4.012s (~) 0.500s 8 1.02x
🐘 Postgres Next.js (Turbopack) 3.614s 4.012s 0.398s 8 1.05x
💻 Local Nitro 8.871s (+4.3%) 9.271s (+2.8%) 0.399s 4 2.57x
💻 Local Express 9.019s (-11.7% 🟢) 9.524s (-13.6% 🟢) 0.505s 4 2.62x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 3.406s (-1.7%) 5.238s (+8.7% 🔺) 1.832s 6 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.757s 1.006s 0.249s 60 1.00x
🐘 Postgres Express 0.807s (-6.6% 🟢) 1.006s (~) 0.199s 60 1.07x
🐘 Postgres Nitro 0.887s (+6.1% 🔺) 1.060s (+3.6%) 0.172s 57 1.17x
💻 Local Express 0.980s (-3.4%) 1.114s (-34.5% 🟢) 0.134s 55 1.29x
💻 Local Nitro 0.996s (+35.2% 🔺) 1.281s (+27.6% 🔺) 0.286s 47 1.32x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 9.039s (+1.1%) 10.832s (+1.6%) 1.793s 6 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 1.858s 2.029s 0.171s 45 1.00x
🐘 Postgres Express 1.920s (-11.0% 🟢) 2.052s (-31.1% 🟢) 0.132s 44 1.03x
🐘 Postgres Nitro 2.091s (+7.6% 🔺) 2.945s (+40.2% 🔺) 0.854s 31 1.13x
💻 Local Express 3.015s (-2.4%) 3.609s (-10.0% 🟢) 0.594s 25 1.62x
💻 Local Nitro 3.050s (+18.8% 🔺) 3.759s (+18.2% 🔺) 0.710s 24 1.64x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 26.404s (-7.8% 🟢) 28.138s (-7.3% 🟢) 1.734s 4 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 3.761s 4.008s 0.247s 30 1.00x
🐘 Postgres Express 3.891s (-9.8% 🟢) 4.078s (-18.6% 🟢) 0.186s 30 1.03x
🐘 Postgres Nitro 4.212s (+5.5% 🔺) 5.012s (+16.7% 🔺) 0.800s 24 1.12x
💻 Local Express 9.155s (-0.6%) 9.864s (-1.5%) 0.709s 13 2.43x
💻 Local Nitro 9.284s (+20.4% 🔺) 9.942s (+21.0% 🔺) 0.658s 13 2.47x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 68.960s (-10.4% 🟢) 70.951s (-9.9% 🟢) 1.991s 2 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.261s 1.007s 0.746s 60 1.00x
🐘 Postgres Nitro 0.285s (+1.0%) 1.007s (~) 0.722s 60 1.09x
🐘 Postgres Express 0.288s (-2.7%) 1.007s (~) 0.719s 60 1.10x
💻 Local Express 0.576s (-3.5%) 1.005s (-1.7%) 0.429s 60 2.21x
💻 Local Nitro 0.604s (-9.0% 🟢) 1.004s (~) 0.401s 60 2.31x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 1.596s (+10.2% 🔺) 3.129s (+4.0%) 1.533s 21 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.482s (-8.4% 🟢) 1.006s (~) 0.524s 90 1.00x
🐘 Postgres Next.js (Turbopack) 0.498s 1.017s 0.519s 89 1.03x
🐘 Postgres Nitro 0.507s (+3.9%) 1.007s (~) 0.499s 90 1.05x
💻 Local Express 2.539s (+1.1%) 3.009s (~) 0.470s 30 5.27x
💻 Local Nitro 2.576s (-6.2% 🟢) 3.009s (-5.4% 🟢) 0.433s 30 5.35x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 3.303s (-1.8%) 5.031s (+4.2%) 1.728s 18 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.756s 1.015s 0.259s 119 1.00x
🐘 Postgres Express 0.776s (-7.7% 🟢) 1.007s (-1.2%) 0.231s 120 1.03x
🐘 Postgres Nitro 0.841s (+7.0% 🔺) 1.020s (+1.3%) 0.178s 118 1.11x
💻 Local Express 11.126s (+1.1%) 11.758s (+0.8%) 0.632s 11 14.72x
💻 Local Nitro 11.320s (+1.6%) 11.936s (+0.8%) 0.617s 11 14.97x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 6.556s (-9.4% 🟢) 8.427s (-2.2%) 1.871s 15 1.00x
▲ Vercel Express ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Next.js (Turbopack)

Stream Benchmarks (includes TTFB metrics)
workflow with stream

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.184s 1.001s 0.001s 1.009s 0.826s 10 1.00x
💻 Local Express 0.200s (-4.4%) 1.005s (~) 0.012s (-2.4%) 1.018s (~) 0.818s 10 1.09x
💻 Local Nitro 0.202s (+37.2% 🔺) 1.004s (~) 0.012s (+31.9% 🔺) 1.018s (~) 0.816s 10 1.10x
🐘 Postgres Express 0.204s (-4.8%) 1.000s (+0.5%) 0.001s (-23.5% 🟢) 1.012s (~) 0.807s 10 1.11x
🐘 Postgres Nitro 0.215s (+7.9% 🔺) 0.999s (~) 0.001s (-25.0% 🟢) 1.011s (~) 0.796s 10 1.17x
💻 Local Next.js (Turbopack) ⚠️ missing - - - - -

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 1.433s (-12.3% 🟢) 2.582s (-13.2% 🟢) 0.596s (+38.5% 🔺) 3.634s (-4.1%) 2.201s 10 1.00x
▲ Vercel Express ⚠️ missing - - - - -
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Next.js (Turbopack)

stream pipeline with 5 transform steps (1MB)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.600s 1.009s 0.005s 1.022s 0.422s 59 1.00x
🐘 Postgres Express 0.604s (-6.6% 🟢) 1.002s (~) 0.004s (-26.6% 🟢) 1.021s (~) 0.417s 59 1.01x
🐘 Postgres Nitro 0.643s (+6.3% 🔺) 1.003s (~) 0.004s (+0.9%) 1.022s (~) 0.379s 59 1.07x
💻 Local Nitro 0.825s (+24.8% 🔺) 1.012s (~) 0.010s (-9.7% 🟢) 1.116s (+8.8% 🔺) 0.291s 54 1.38x
💻 Local Express 0.931s (+26.6% 🔺) 1.011s (~) 0.009s (~) 1.227s (+19.9% 🔺) 0.296s 49 1.55x
💻 Local Next.js (Turbopack) ⚠️ missing - - - - -

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 4.378s (+6.5% 🔺) 5.816s (+4.2%) 0.498s (-31.4% 🟢) 6.789s (+1.6%) 2.411s 9 1.00x
▲ Vercel Express ⚠️ missing - - - - -
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.928s 1.135s 0.000s 1.156s 0.228s 52 1.00x
🐘 Postgres Express 0.949s (-4.3%) 1.169s (-12.4% 🟢) 0.000s (+69.2% 🔺) 1.190s (-13.2% 🟢) 0.240s 52 1.02x
🐘 Postgres Nitro 0.949s (~) 1.246s (+8.6% 🔺) 0.000s (+8.3% 🔺) 1.258s (+8.3% 🔺) 0.309s 48 1.02x
💻 Local Express 1.217s (-4.5%) 2.019s (~) 0.000s (+9.1% 🔺) 2.021s (~) 0.804s 30 1.31x
💻 Local Nitro 1.244s (-6.1% 🟢) 2.021s (~) 0.001s (-11.8% 🟢) 2.023s (~) 0.779s 30 1.34x
💻 Local Next.js (Turbopack) ⚠️ missing - - - - -

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 2.937s (-9.7% 🟢) 4.419s (+0.8%) 0.000s (+66.7% 🔺) 4.936s (+3.5%) 1.999s 13 1.00x
▲ Vercel Express ⚠️ missing - - - - -
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.683s (-5.8% 🟢) 2.031s (-5.2% 🟢) 0.000s (+Infinity% 🔺) 2.073s (-3.7%) 0.390s 29 1.00x
🐘 Postgres Nitro 1.810s (+1.5%) 2.172s (+3.5%) 0.000s (~) 2.203s (+4.3%) 0.393s 29 1.08x
🐘 Postgres Next.js (Turbopack) 1.835s 2.106s 0.000s 2.113s 0.277s 29 1.09x
💻 Local Express 3.440s (-6.1% 🟢) 4.032s (-3.3%) 0.000s (-81.8% 🟢) 4.034s (-3.3%) 0.594s 15 2.04x
💻 Local Nitro 3.503s (-11.2% 🟢) 4.034s (-11.0% 🟢) 0.000s (-74.5% 🟢) 4.036s (-11.0% 🟢) 0.533s 15 2.08x
💻 Local Next.js (Turbopack) ⚠️ missing - - - - -

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Next.js (Turbopack) 3.795s (-12.8% 🟢) 4.998s (-10.4% 🟢) 0.000s (-33.3% 🟢) 5.490s (-8.2% 🟢) 1.695s 11 1.00x
▲ Vercel Express ⚠️ missing - - - - -
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World 🥇 Fastest Framework Wins
💻 Local Express 18/21
🐘 Postgres Next.js (Turbopack) 15/21
▲ Vercel Next.js (Turbopack) 21/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework 🥇 Fastest World Wins
Express 🐘 Postgres 18/21
Next.js (Turbopack) 🐘 Postgres 19/21
Nitro 🐘 Postgres 17/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: cancelled
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 10, 2026

🧪 E2E Test Results

All tests passed

Summary

Passed Failed Skipped Total
✅ ▲ Vercel Production 923 0 67 990
✅ 💻 Local Development 898 0 182 1080
✅ 📦 Local Production 898 0 182 1080
✅ 🐘 Local Postgres 898 0 182 1080
✅ 🪟 Windows 82 0 8 90
✅ 📋 Other 228 0 42 270
Total 3927 0 663 4590

Details by Category

✅ ▲ Vercel Production
App Passed Failed Skipped
✅ astro 83 0 7
✅ example 83 0 7
✅ express 83 0 7
✅ fastify 83 0 7
✅ hono 83 0 7
✅ nextjs-turbopack 88 0 2
✅ nextjs-webpack 88 0 2
✅ nitro 83 0 7
✅ nuxt 83 0 7
✅ sveltekit 83 0 7
✅ vite 83 0 7
✅ 💻 Local Development
App Passed Failed Skipped
✅ astro-stable 76 0 14
✅ express-stable 76 0 14
✅ fastify-stable 76 0 14
✅ hono-stable 76 0 14
✅ nextjs-turbopack-canary 63 0 27
✅ nextjs-turbopack-stable 82 0 8
✅ nextjs-webpack-canary 63 0 27
✅ nextjs-webpack-stable 82 0 8
✅ nitro-stable 76 0 14
✅ nuxt-stable 76 0 14
✅ sveltekit-stable 76 0 14
✅ vite-stable 76 0 14
✅ 📦 Local Production
App Passed Failed Skipped
✅ astro-stable 76 0 14
✅ express-stable 76 0 14
✅ fastify-stable 76 0 14
✅ hono-stable 76 0 14
✅ nextjs-turbopack-canary 63 0 27
✅ nextjs-turbopack-stable 82 0 8
✅ nextjs-webpack-canary 63 0 27
✅ nextjs-webpack-stable 82 0 8
✅ nitro-stable 76 0 14
✅ nuxt-stable 76 0 14
✅ sveltekit-stable 76 0 14
✅ vite-stable 76 0 14
✅ 🐘 Local Postgres
App Passed Failed Skipped
✅ astro-stable 76 0 14
✅ express-stable 76 0 14
✅ fastify-stable 76 0 14
✅ hono-stable 76 0 14
✅ nextjs-turbopack-canary 63 0 27
✅ nextjs-turbopack-stable 82 0 8
✅ nextjs-webpack-canary 63 0 27
✅ nextjs-webpack-stable 82 0 8
✅ nitro-stable 76 0 14
✅ nuxt-stable 76 0 14
✅ sveltekit-stable 76 0 14
✅ vite-stable 76 0 14
✅ 🪟 Windows
App Passed Failed Skipped
✅ nextjs-turbopack 82 0 8
✅ 📋 Other
App Passed Failed Skipped
✅ e2e-local-dev-nest-stable 76 0 14
✅ e2e-local-postgres-nest-stable 76 0 14
✅ e2e-local-prod-nest-stable 76 0 14

📋 View full workflow run

Comment on lines 25 to +26
export const SPEC_VERSION_SUPPORTS_CBOR_QUEUE_TRANSPORT = 3 as SpecVersion;
export const SPEC_VERSION_SUPPORTS_RESTRUCTURED_WORLD = 4 as SpecVersion;
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think these are valid spec version bumps... the actual spec of the workflow events hasn't changed, and I don't think runs with a v3 event log are incompatible with a v2 runtime and so on...

Copy link
Copy Markdown
Collaborator

@pranaygp pranaygp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think we should change the even log spec version if the event log never changed

@VaguelySerious VaguelySerious marked this pull request as draft April 10, 2026 16:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants