Skip to content

fix(builders): improve hook graph detection in transformed bundles#1675

Draft
ijjk wants to merge 9 commits intomainfrom
ijjk/lazy-discovery-webhook
Draft

fix(builders): improve hook graph detection in transformed bundles#1675
ijjk wants to merge 9 commits intomainfrom
ijjk/lazy-discovery-webhook

Conversation

@ijjk
Copy link
Copy Markdown
Member

@ijjk ijjk commented Apr 9, 2026 •
edited
Loading

Summary

  • fix workflow graph extraction for transformed bundles where step declarations include @__PURE__ annotations
  • detect createHook/createWebhook when wrapped by transpiled using helper calls
  • add regression tests covering both transformed patterns

Validation

  • pnpm -C packages/builders test -- workflows-extractor.test.ts
  • pnpm -C packages/builders typecheck

@vercel
Copy link
Copy Markdown
Contributor

vercel bot commented Apr 9, 2026 •
edited
Loading

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
example-nextjs-workflow-turbopack Ready Ready Preview, Comment Apr 10, 2026 8:09pm
example-nextjs-workflow-webpack Ready Ready Preview, Comment Apr 10, 2026 8:09pm
example-workflow Ready Ready Preview, Comment Apr 10, 2026 8:09pm
workbench-astro-workflow Ready Ready Preview, Comment Apr 10, 2026 8:09pm
workbench-express-workflow Ready Ready Preview, Comment Apr 10, 2026 8:09pm
workbench-fastify-workflow Ready Ready Preview, Comment Apr 10, 2026 8:09pm
workbench-hono-workflow Ready Ready Preview, Comment Apr 10, 2026 8:09pm
workbench-nitro-workflow Ready Ready Preview, Comment Apr 10, 2026 8:09pm
workbench-nuxt-workflow Ready Ready Preview, Comment Apr 10, 2026 8:09pm
workbench-sveltekit-workflow Ready Ready Preview, Comment Apr 10, 2026 8:09pm
workbench-vite-workflow Ready Ready Preview, Comment Apr 10, 2026 8:09pm
workflow-docs Ready Ready Preview, Comment, Open in v0 Apr 10, 2026 8:09pm
workflow-swc-playground Ready Ready Preview, Comment Apr 10, 2026 8:09pm

@changeset-bot
Copy link
Copy Markdown

changeset-bot bot commented Apr 9, 2026 •
edited
Loading

🦋 Changeset detected

Latest commit: 91783a1

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 21 packages
Name Type
@workflow/builders Patch
@workflow/utils Patch
@workflow/astro Patch
@workflow/cli Patch
@workflow/nest Patch
@workflow/next Patch
@workflow/nitro Patch
@workflow/rollup Patch
@workflow/sveltekit Patch
@workflow/vite Patch
@workflow/vitest Patch
@workflow/core Patch
@workflow/errors Patch
@workflow/web-shared Patch
workflow Patch
@workflow/world-local Patch
@workflow/world-postgres Patch
@workflow/world-testing Patch
@workflow/nuxt Patch
@workflow/world-vercel Patch
@workflow/ai Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 9, 2026 •
edited
Loading

🧪 E2E Test Results

❌ Some tests failed

Summary

Passed Failed Skipped Total
✅ ▲ Vercel Production 912 0 67 979
✅ 💻 Local Development 886 0 182 1068
✅ 📦 Local Production 886 0 182 1068
✅ 🐘 Local Postgres 886 0 182 1068
✅ 🪟 Windows 81 0 8 89
❌ 🌍 Community Worlds 133 74 24 231
✅ 📋 Other 225 0 42 267
Total 4009 74 687 4770

❌ Failed Tests

🌍 Community Worlds (74 failed)

mongodb (7 failed):

  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KNWG7A77VAYN9JBVQM593DY6
  • webhookWorkflow | wrun_01KNWG7JM9T281DNJX8BMA5WS6
  • fetchWorkflow | wrun_01KNWGAXM75MJD7FTZRRXF9D2C
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KNWGEXNXET877KZ0ZE7FKM30
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • health check (CLI) - workflow health command reports healthy endpoints
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_01KNWGMV3V90G7F3VD3YQPP0CJ

redis (7 failed):

  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KNWG7A77VAYN9JBVQM593DY6
  • webhookWorkflow | wrun_01KNWG7JM9T281DNJX8BMA5WS6
  • fetchWorkflow | wrun_01KNWGAXM75MJD7FTZRRXF9D2C
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KNWGEXNXET877KZ0ZE7FKM30
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • health check (CLI) - workflow health command reports healthy endpoints
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_01KNWGMV3V90G7F3VD3YQPP0CJ

turso (60 failed):

  • addTenWorkflow | wrun_01KNWG67CCN52NQ71FSA8PSV5N
  • addTenWorkflow | wrun_01KNWG67CCN52NQ71FSA8PSV5N
  • wellKnownAgentWorkflow (.well-known/agent) | wrun_01KNWG7E2BPKX4Q9FX8YQMBNQD
  • should work with react rendering in step
  • promiseAllWorkflow | wrun_01KNWG6D7JHKAB16B7KBN6JZSV
  • promiseRaceWorkflow | wrun_01KNWG6HB3ZCXGW9NKEF6M2MBJ
  • promiseAnyWorkflow | wrun_01KNWG6K67EWYCQVYAVV8FQ1M8
  • importedStepOnlyWorkflow | wrun_01KNWG7T5G0TXES7N3Z0MFZHKE
  • hookWorkflow | wrun_01KNWG6Z6TBW21TZYHQPKXX4AV
  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KNWG7A77VAYN9JBVQM593DY6
  • webhookWorkflow | wrun_01KNWG7JM9T281DNJX8BMA5WS6
  • sleepingWorkflow | wrun_01KNWG7RVQVQQJJG33AN2CH4GN
  • parallelSleepWorkflow | wrun_01KNWG84V7SRARHC9TGMCKQ7GH
  • nullByteWorkflow | wrun_01KNWG885P3M79H6S5DKJZ79J9
  • workflowAndStepMetadataWorkflow | wrun_01KNWG89ZXFBSC9YDQQ51GETSF
  • fetchWorkflow | wrun_01KNWGAXM75MJD7FTZRRXF9D2C
  • promiseRaceStressTestWorkflow | wrun_01KNWGB0KJ0VGTCSQTJDE3GZJJ
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling retry behavior RetryableError respects custom retryAfter delay
  • error handling retry behavior maxRetries=0 disables retries
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • error handling not registered WorkflowNotRegisteredError fails the run when workflow does not exist
  • error handling not registered StepNotRegisteredError fails the step but workflow can catch it
  • error handling not registered StepNotRegisteredError fails the run when not caught in workflow
  • hookCleanupTestWorkflow - hook token reuse after workflow completion | wrun_01KNWGEAJ0B0DSSY0T56FSGV4R
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KNWGEXNXET877KZ0ZE7FKM30
  • hookDisposeTestWorkflow - hook token reuse after explicit disposal while workflow still running | wrun_01KNWGFJG1BSSXZ5P7DVE81002
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars) | wrun_01KNWGG5Q002Z6JT7248Y1WFMG
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument | wrun_01KNWGGDHJ11BCZDFP6YY5V7VG
  • closureVariableWorkflow - nested step functions with closure variables | wrun_01KNWGGJ6ZRMCPQKDM1JYHSY0P
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step | wrun_01KNWGGMCNV2BAE44C216HBWPS
  • runClassSerializationWorkflow - Run instances serialize across workflow/step boundaries
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • health check (CLI) - workflow health command reports healthy endpoints
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly | wrun_01KNWGH349BC6Q53BGABR81ZKY
  • Calculator.calculate - static workflow method using static step methods from another class | wrun_01KNWGH81QH40EV64F268Q110K
  • AllInOneService.processNumber - static workflow method using sibling static step methods | wrun_01KNWGHDX5XEE7D786K83MYMXB
  • ChainableService.processWithThis - static step methods using this to reference the class | wrun_01KNWGHMEPH0Q3V9ZEX20B6F8W
  • thisSerializationWorkflow - step function invoked with .call() and .apply() | wrun_01KNWGHTBVWMSNMEJMRNZEK88V
  • customSerializationWorkflow - custom class serialization with WORKFLOW_SERIALIZE/WORKFLOW_DESERIALIZE | wrun_01KNWGJ0C9XF7RNK8GG68Q0PN3
  • instanceMethodStepWorkflow - instance methods with "use step" directive | wrun_01KNWGJ6CQX67ACHFQ1G4PTWCR
  • crossContextSerdeWorkflow - classes defined in step code are deserializable in workflow context | wrun_01KNWGJGQN37W42Q5P4QB7GXW1
  • stepFunctionAsStartArgWorkflow - step function reference passed as start() argument | wrun_01KNWGJSHXAHHZCGABQ5JPED50
  • cancelRun - cancelling a running workflow | wrun_01KNWGJZH5T0RMY6HJF7JHJE8J
  • cancelRun via CLI - cancelling a running workflow | wrun_01KNWGK8J3GMBPSPJME5262VNE
  • pages router addTenWorkflow via pages router
  • pages router promiseAllWorkflow via pages router
  • pages router sleepingWorkflow via pages router
  • hookWithSleepWorkflow - hook payloads delivered correctly with concurrent sleep | wrun_01KNWGKKFBXCQ7VYNXW0A8G2C8
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_01KNWGM6RVMK371522G320HY2G
  • sleepWithSequentialStepsWorkflow - sequential steps work with concurrent sleep (control) | wrun_01KNWGMHK8J6M1FF978CPGCRTN
  • importMetaUrlWorkflow - import.meta.url is available in step bundles | wrun_01KNWGMQCC8MR89A7J0V2TNZ9Y
  • metadataFromHelperWorkflow - getWorkflowMetadata/getStepMetadata work from module-level helper (#1577) | wrun_01KNWGMS9BPSDKXQCXTAN6DAAP
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_01KNWGMV3V90G7F3VD3YQPP0CJ
  • getterStepWorkflow - getter functions with "use step" directive | wrun_01KNWGMYMQKACZK6AA5KGCG0M2

Details by Category

✅ ▲ Vercel Production
App Passed Failed Skipped
✅ astro 82 0 7
✅ example 82 0 7
✅ express 82 0 7
✅ fastify 82 0 7
✅ hono 82 0 7
✅ nextjs-turbopack 87 0 2
✅ nextjs-webpack 87 0 2
✅ nitro 82 0 7
✅ nuxt 82 0 7
✅ sveltekit 82 0 7
✅ vite 82 0 7
✅ 💻 Local Development
App Passed Failed Skipped
✅ astro-stable 75 0 14
✅ express-stable 75 0 14
✅ fastify-stable 75 0 14
✅ hono-stable 75 0 14
✅ nextjs-turbopack-canary 62 0 27
✅ nextjs-turbopack-stable 81 0 8
✅ nextjs-webpack-canary 62 0 27
✅ nextjs-webpack-stable 81 0 8
✅ nitro-stable 75 0 14
✅ nuxt-stable 75 0 14
✅ sveltekit-stable 75 0 14
✅ vite-stable 75 0 14
✅ 📦 Local Production
App Passed Failed Skipped
✅ astro-stable 75 0 14
✅ express-stable 75 0 14
✅ fastify-stable 75 0 14
✅ hono-stable 75 0 14
✅ nextjs-turbopack-canary 62 0 27
✅ nextjs-turbopack-stable 81 0 8
✅ nextjs-webpack-canary 62 0 27
✅ nextjs-webpack-stable 81 0 8
✅ nitro-stable 75 0 14
✅ nuxt-stable 75 0 14
✅ sveltekit-stable 75 0 14
✅ vite-stable 75 0 14
✅ 🐘 Local Postgres
App Passed Failed Skipped
✅ astro-stable 75 0 14
✅ express-stable 75 0 14
✅ fastify-stable 75 0 14
✅ hono-stable 75 0 14
✅ nextjs-turbopack-canary 62 0 27
✅ nextjs-turbopack-stable 81 0 8
✅ nextjs-webpack-canary 62 0 27
✅ nextjs-webpack-stable 81 0 8
✅ nitro-stable 75 0 14
✅ nuxt-stable 75 0 14
✅ sveltekit-stable 75 0 14
✅ vite-stable 75 0 14
✅ 🪟 Windows
App Passed Failed Skipped
✅ nextjs-turbopack 81 0 8
❌ 🌍 Community Worlds
App Passed Failed Skipped
✅ mongodb-dev 6 0 0
❌ mongodb 56 7 8
✅ redis-dev 6 0 0
❌ redis 56 7 8
✅ turso-dev 6 0 0
❌ turso 3 60 8
✅ 📋 Other
App Passed Failed Skipped
✅ e2e-local-dev-nest-stable 75 0 14
✅ e2e-local-postgres-nest-stable 75 0 14
✅ e2e-local-prod-nest-stable 75 0 14

📋 View full workflow run

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 9, 2026 •
edited
Loading

📊 Benchmark Results

⚠️ Results below are stale and not from the latest commit. This comment will be updated when CI completes on the latest run.

⏳ Benchmarks are running...

Started at: 2026-04-10T20:06:43Z

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 0.042s (-2.1%) 1.005s (~) 0.963s 10 1.00x
💻 Local Nitro 0.045s (+20.2% 🔺) 1.005s (~) 0.961s 10 1.06x
🐘 Postgres Express 0.049s (-25.8% 🟢) 1.009s (~) 0.960s 10 1.17x
🐘 Postgres Nitro 0.051s (-19.8% 🟢) 1.011s (~) 0.960s 10 1.21x
🐘 Postgres Next.js (Turbopack) 0.062s 1.009s 0.947s 10 1.48x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 0.218s (-10.0% 🟢) 2.268s (+6.8% 🔺) 2.050s 10 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 1 step

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.119s (-2.3%) 2.009s (~) 0.890s 10 1.00x
💻 Local Express 1.125s (-0.6%) 2.005s (~) 0.881s 10 1.00x
💻 Local Nitro 1.128s (+2.4%) 2.005s (~) 0.877s 10 1.01x
🐘 Postgres Nitro 1.131s (-1.7%) 2.012s (~) 0.882s 10 1.01x
🐘 Postgres Next.js (Turbopack) 1.131s 2.010s 0.879s 10 1.01x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 1.995s (+6.6% 🔺) 3.697s (-3.8%) 1.702s 10 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 10 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 10.677s (-1.8%) 11.022s (~) 0.345s 3 1.00x
🐘 Postgres Nitro 10.790s (-0.6%) 11.025s (~) 0.234s 3 1.01x
🐘 Postgres Next.js (Turbopack) 10.817s 11.019s 0.202s 3 1.01x
💻 Local Express 10.919s (~) 11.023s (~) 0.104s 3 1.02x
💻 Local Nitro 10.945s (+2.6%) 11.024s (~) 0.079s 3 1.03x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 16.646s (-0.5%) 18.728s (~) 2.081s 2 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 25 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 14.059s (-3.5%) 15.024s (~) 0.965s 4 1.00x
🐘 Postgres Nitro 14.204s (-2.0%) 15.030s (~) 0.826s 4 1.01x
🐘 Postgres Next.js (Turbopack) 14.424s 15.021s 0.598s 4 1.03x
💻 Local Nitro 14.958s (+5.2% 🔺) 15.030s (~) 0.072s 4 1.06x
💻 Local Express 14.985s (~) 15.028s (-6.3% 🟢) 0.043s 4 1.07x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 31.544s (+4.6%) 34.041s (+5.6% 🔺) 2.497s 2 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 50 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 12.980s (-7.9% 🟢) 13.304s (-9.7% 🟢) 0.324s 7 1.00x
🐘 Postgres Nitro 13.320s (-3.9%) 14.026s (~) 0.706s 7 1.03x
🐘 Postgres Next.js (Turbopack) 13.678s 14.023s 0.345s 7 1.05x
💻 Local Nitro 16.349s (+9.6% 🔺) 17.030s (+13.3% 🔺) 0.681s 6 1.26x
💻 Local Express 16.623s (-1.8%) 17.030s (~) 0.407s 6 1.28x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 50.971s (-3.0%) 52.442s (-4.2%) 1.471s 2 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

Promise.all with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.206s (-5.2% 🟢) 2.009s (~) 0.803s 15 1.00x
🐘 Postgres Nitro 1.216s (-4.0%) 2.010s (~) 0.795s 15 1.01x
🐘 Postgres Next.js (Turbopack) 1.232s 2.008s 0.776s 15 1.02x
💻 Local Express 1.507s (-1.4%) 2.005s (~) 0.498s 15 1.25x
💻 Local Nitro 1.511s (+1.0%) 2.005s (~) 0.495s 15 1.25x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 1.971s (-16.9% 🟢) 3.571s (-13.6% 🟢) 1.600s 9 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

Promise.all with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 2.271s (-2.5%) 3.009s (~) 0.737s 10 1.00x
🐘 Postgres Nitro 2.309s (-2.1%) 3.010s (~) 0.701s 10 1.02x
🐘 Postgres Next.js (Turbopack) 2.387s 3.008s 0.622s 10 1.05x
💻 Local Nitro 2.857s (+4.8%) 3.108s (-3.1%) 0.250s 10 1.26x
💻 Local Express 2.926s (-8.1% 🟢) 3.452s (-13.9% 🟢) 0.526s 9 1.29x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.534s (-4.3%) 4.042s (-1.4%) 1.509s 8 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

Promise.all with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 3.379s (-3.5%) 4.010s (~) 0.631s 8 1.00x
🐘 Postgres Nitro 3.412s (-2.6%) 4.011s (~) 0.599s 8 1.01x
🐘 Postgres Next.js (Turbopack) 3.651s 4.011s 0.359s 8 1.08x
💻 Local Nitro 7.385s (-4.6%) 8.021s (-5.8% 🟢) 0.636s 4 2.19x
💻 Local Express 8.351s (~) 9.026s (~) 0.675s 4 2.47x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.876s (-2.4%) 4.602s (-2.4%) 1.726s 7 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

Promise.race with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 1.191s (-5.3% 🟢) 2.008s (~) 0.817s 15 1.00x
🐘 Postgres Express 1.222s (-5.7% 🟢) 2.008s (~) 0.785s 15 1.03x
🐘 Postgres Next.js (Turbopack) 1.231s 2.010s 0.779s 15 1.03x
💻 Local Nitro 1.497s (-0.6%) 2.006s (~) 0.509s 15 1.26x
💻 Local Express 1.582s (+1.1%) 2.074s (+3.4%) 0.492s 15 1.33x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.091s (+8.6% 🔺) 3.762s (+1.3%) 1.671s 8 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

Promise.race with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 2.260s (-5.0% 🟢) 3.008s (~) 0.748s 10 1.00x
🐘 Postgres Nitro 2.313s (-1.0%) 3.010s (~) 0.697s 10 1.02x
🐘 Postgres Next.js (Turbopack) 2.375s 3.007s 0.632s 10 1.05x
💻 Local Nitro 2.817s (-19.5% 🟢) 3.007s (-25.1% 🟢) 0.190s 10 1.25x
💻 Local Express 3.257s (+2.7%) 4.010s (+3.2%) 0.753s 8 1.44x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.345s (-10.5% 🟢) 4.100s (-7.1% 🟢) 1.755s 8 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

Promise.race with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 3.395s (-2.7%) 4.009s (~) 0.614s 8 1.00x
🐘 Postgres Nitro 3.410s (-1.7%) 4.012s (~) 0.602s 8 1.00x
🐘 Postgres Next.js (Turbopack) 3.637s 4.009s 0.372s 8 1.07x
💻 Local Nitro 7.974s (-6.2% 🟢) 8.522s (-5.5% 🟢) 0.548s 4 2.35x
💻 Local Express 8.911s (-12.8% 🟢) 9.272s (-15.9% 🟢) 0.360s 4 2.63x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.600s (-11.4% 🟢) 4.131s (-1.9%) 1.531s 8 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.595s (-31.2% 🟢) 1.006s (~) 0.411s 60 1.00x
🐘 Postgres Nitro 0.647s (-22.7% 🟢) 1.007s (-1.6%) 0.360s 60 1.09x
🐘 Postgres Next.js (Turbopack) 0.743s 1.006s 0.262s 60 1.25x
💻 Local Express 0.987s (-2.7%) 1.181s (-30.5% 🟢) 0.194s 51 1.66x
💻 Local Nitro 1.007s (+36.6% 🔺) 1.338s (+33.2% 🔺) 0.331s 45 1.69x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 9.099s (-1.0%) 11.126s (+1.3%) 2.027s 6 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.443s (-33.1% 🟢) 2.007s (-32.6% 🟢) 0.564s 45 1.00x
🐘 Postgres Nitro 1.561s (-19.7% 🟢) 2.009s (-4.4%) 0.447s 45 1.08x
🐘 Postgres Next.js (Turbopack) 1.879s 2.075s 0.196s 44 1.30x
💻 Local Nitro 3.012s (+17.3% 🔺) 3.649s (+14.7% 🔺) 0.637s 25 2.09x
💻 Local Express 3.030s (-2.0%) 3.649s (-9.0% 🟢) 0.619s 25 2.10x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 27.545s (-1.5%) 29.102s (-2.8%) 1.557s 4 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 3.067s (-28.9% 🟢) 3.597s (-28.2% 🟢) 0.530s 34 1.00x
🐘 Postgres Nitro 3.276s (-17.9% 🟢) 4.011s (-6.6% 🟢) 0.735s 30 1.07x
🐘 Postgres Next.js (Turbopack) 3.722s 4.010s 0.287s 30 1.21x
💻 Local Nitro 8.993s (+16.6% 🔺) 9.402s (+14.4% 🔺) 0.409s 13 2.93x
💻 Local Express 9.255s (+0.5%) 9.942s (-0.8%) 0.687s 13 3.02x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 71.249s (-9.1% 🟢) 73.340s (-8.6% 🟢) 2.091s 2 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.226s (-23.6% 🟢) 1.007s (~) 0.781s 60 1.00x
🐘 Postgres Nitro 0.232s (-17.7% 🟢) 1.007s (~) 0.775s 60 1.03x
🐘 Postgres Next.js (Turbopack) 0.246s 1.006s 0.760s 60 1.09x
💻 Local Nitro 0.559s (-15.8% 🟢) 1.004s (~) 0.445s 60 2.47x
💻 Local Express 0.592s (-0.9%) 1.005s (-1.7%) 0.413s 60 2.62x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 1.415s (-7.0% 🟢) 2.889s (-6.7% 🟢) 1.473s 21 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.365s (-30.5% 🟢) 1.006s (~) 0.640s 90 1.00x
🐘 Postgres Nitro 0.381s (-22.1% 🟢) 1.006s (~) 0.626s 90 1.04x
🐘 Postgres Next.js (Turbopack) 0.467s 1.006s 0.539s 90 1.28x
💻 Local Nitro 2.410s (-12.3% 🟢) 3.008s (-5.5% 🟢) 0.598s 30 6.60x
💻 Local Express 2.571s (+2.4%) 3.009s (~) 0.438s 30 7.04x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.557s (-6.6% 🟢) 4.320s (-0.7%) 1.762s 21 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.576s (-31.4% 🟢) 1.006s (-1.2%) 0.430s 120 1.00x
🐘 Postgres Nitro 0.609s (-22.5% 🟢) 1.007s (~) 0.398s 120 1.06x
🐘 Postgres Next.js (Turbopack) 0.742s 1.006s 0.263s 120 1.29x
💻 Local Nitro 10.536s (-5.4% 🟢) 11.117s (-6.2% 🟢) 0.581s 11 18.28x
💻 Local Express 11.134s (+1.2%) 11.940s (+2.4%) 0.806s 11 19.32x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 6.079s (-11.2% 🟢) 7.644s (-12.1% 🟢) 1.565s 16 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

Stream Benchmarks (includes TTFB metrics)
workflow with stream

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.148s (-30.9% 🟢) 1.001s (+0.7%) 0.001s (-29.4% 🟢) 1.009s (~) 0.861s 10 1.00x
🐘 Postgres Nitro 0.172s (-13.5% 🟢) 0.997s (~) 0.001s (-31.3% 🟢) 1.012s (~) 0.840s 10 1.16x
🐘 Postgres Next.js (Turbopack) 0.187s 1.001s 0.001s 1.010s 0.823s 10 1.26x
💻 Local Nitro 0.202s (+37.0% 🔺) 1.004s (~) 0.010s (+13.2% 🔺) 1.016s (~) 0.814s 10 1.36x
💻 Local Express 0.202s (-3.3%) 1.004s (~) 0.012s (-1.6%) 1.018s (~) 0.815s 10 1.36x
💻 Local Next.js (Turbopack) ⚠️ missing - - - - -

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 1.522s (+2.9%) 2.584s (-14.6% 🟢) 0.624s (+105.9% 🔺) 3.701s (-1.7%) 2.179s 10 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - - -
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Express

stream pipeline with 5 transform steps (1MB)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.504s (-22.1% 🟢) 1.007s (~) 0.004s (-29.6% 🟢) 1.019s (~) 0.516s 59 1.00x
🐘 Postgres Nitro 0.541s (-10.6% 🟢) 1.007s (~) 0.004s (-11.9% 🟢) 1.022s (~) 0.481s 59 1.07x
🐘 Postgres Next.js (Turbopack) 0.600s 1.008s 0.004s 1.021s 0.421s 59 1.19x
💻 Local Express 0.814s (+10.7% 🔺) 1.012s (~) 0.009s (-2.9%) 1.116s (+9.0% 🔺) 0.302s 54 1.62x
💻 Local Nitro 0.845s (+27.7% 🔺) 1.011s (~) 0.010s (-9.9% 🟢) 1.115s (+8.7% 🔺) 0.270s 54 1.68x
💻 Local Next.js (Turbopack) ⚠️ missing - - - - -

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 4.071s (-3.6%) 5.634s (-3.7%) 0.573s (+160.5% 🔺) 6.634s (+2.2%) 2.563s 10 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - - -
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Express

10 parallel streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 0.912s (-8.1% 🟢) 1.051s (-21.3% 🟢) 0.000s (+15.8% 🔺) 1.060s (-22.6% 🟢) 0.148s 57 1.00x
🐘 Postgres Next.js (Turbopack) 0.924s 1.113s 0.000s 1.135s 0.211s 53 1.01x
🐘 Postgres Nitro 0.962s (+1.8%) 1.154s (+0.6%) 0.000s (+33.3% 🔺) 1.162s (~) 0.200s 52 1.05x
💻 Local Express 1.214s (-4.7%) 2.020s (~) 0.001s (+45.5% 🔺) 2.022s (~) 0.808s 30 1.33x
💻 Local Nitro 1.227s (-7.4% 🟢) 2.021s (~) 0.001s (~) 2.023s (~) 0.795s 30 1.35x
💻 Local Next.js (Turbopack) ⚠️ missing - - - - -

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.625s (-0.7%) 3.640s (-2.0%) 0.000s (-100.0% 🟢) 4.056s (-2.1%) 1.431s 15 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - - -
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Express

fan-out fan-in 10 streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.673s (-6.4% 🟢) 2.103s (-1.8%) 0.000s (NaN%) 2.111s (-1.9%) 0.438s 29 1.00x
🐘 Postgres Nitro 1.799s (+0.9%) 2.145s (+2.3%) 0.000s (+3.6%) 2.152s (+1.9%) 0.353s 28 1.08x
🐘 Postgres Next.js (Turbopack) 1.819s 2.102s 0.000s 2.125s 0.306s 29 1.09x
💻 Local Nitro 3.325s (-15.7% 🟢) 4.034s (-11.0% 🟢) 0.000s (-40.6% 🟢) 4.036s (-11.0% 🟢) 0.711s 15 1.99x
💻 Local Express 3.445s (-5.9% 🟢) 4.099s (-1.7%) 0.000s (-63.6% 🟢) 4.102s (-1.7%) 0.657s 15 2.06x
💻 Local Next.js (Turbopack) ⚠️ missing - - - - -

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 3.375s (-0.6%) 4.873s (~) 0.000s (-100.0% 🟢) 5.292s (~) 1.917s 12 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - - -
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Express

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World 🥇 Fastest Framework Wins
💻 Local Nitro 14/21
🐘 Postgres Express 20/21
▲ Vercel Express 21/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework 🥇 Fastest World Wins
Express 🐘 Postgres 18/21
Next.js (Turbopack) 🐘 Postgres 21/21
Nitro 🐘 Postgres 19/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run

❌ Some benchmark jobs failed:

  • Local: cancelled
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@ijjk