Skip to content

fix(builders): skip Node.js builtins in esbuild alias fallback#1645

Closed
VaguelySerious wants to merge 1 commit into
mainfrom
peter/fix-builtin-externalization
Closed

fix(builders): skip Node.js builtins in esbuild alias fallback#1645
VaguelySerious wants to merge 1 commit into
mainfrom
peter/fix-builtin-externalization

Conversation

@VaguelySerious
Copy link
Copy Markdown
Member

Summary

  • PR fix(builders): resolve path aliases when externalizing non-step imports #1613 added an esbuild fallback for resolving path aliases when enhanced-resolve fails
  • Node.js builtins (crypto, node:path, etc.) also fail enhanced-resolve, and esbuild resolves them to absolute paths outside node_modules
  • The isProjectLocalFile check then incorrectly treats them as project files and relativizes them (e.g. ../../../../../../crypto), breaking Next.js webpack builds

Fix: Check isBuiltin(specifier) before falling through to the esbuild resolver so builtins stay as bare specifiers.

Test plan

  • Added test: "keeps Node.js builtins as bare specifiers when enhanced-resolve fails"
  • All existing builder tests pass (19/19)
  • Verify agents/apps/vade-review builds successfully with this fix

🤖 Generated with Claude Code

PR #1613 added an esbuild fallback for resolving path aliases when
enhanced-resolve fails. However, Node.js builtins like `crypto` and
`node:path` also fail enhanced-resolve, and esbuild resolves them to
absolute paths outside node_modules. The `isProjectLocalFile` check
then incorrectly relativizes them (e.g. `../../../../../../crypto`),
breaking Next.js builds.

Fix: check `isBuiltin(specifier)` before falling through to the
esbuild resolver, so builtins are left as bare specifiers.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@VaguelySerious VaguelySerious requested a review from a team as a code owner April 7, 2026 20:26
@vercel
Copy link
Copy Markdown
Contributor

vercel Bot commented Apr 7, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
example-nextjs-workflow-turbopack Ready Ready Preview, Comment Apr 7, 2026 8:28pm
example-nextjs-workflow-webpack Ready Ready Preview, Comment Apr 7, 2026 8:28pm
example-workflow Ready Ready Preview, Comment Apr 7, 2026 8:28pm
workbench-astro-workflow Ready Ready Preview, Comment Apr 7, 2026 8:28pm
workbench-express-workflow Ready Ready Preview, Comment Apr 7, 2026 8:28pm
workbench-fastify-workflow Ready Ready Preview, Comment Apr 7, 2026 8:28pm
workbench-hono-workflow Ready Ready Preview, Comment Apr 7, 2026 8:28pm
workbench-nitro-workflow Ready Ready Preview, Comment Apr 7, 2026 8:28pm
workbench-nuxt-workflow Ready Ready Preview, Comment Apr 7, 2026 8:28pm
workbench-sveltekit-workflow Ready Ready Preview, Comment Apr 7, 2026 8:28pm
workbench-vite-workflow Ready Ready Preview, Comment Apr 7, 2026 8:28pm
workflow-docs Ready Ready Preview, Comment, Open in v0 Apr 7, 2026 8:28pm
workflow-swc-playground Ready Ready Preview, Comment Apr 7, 2026 8:28pm

@changeset-bot
Copy link
Copy Markdown

changeset-bot Bot commented Apr 7, 2026

🦋 Changeset detected

Latest commit: 6ae59ca

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
Name Type
@workflow/builders Patch
@workflow/astro Patch
@workflow/cli Patch
@workflow/nest Patch
@workflow/next Patch
@workflow/nitro Patch
@workflow/rollup Patch
@workflow/sveltekit Patch
@workflow/vite Patch
@workflow/vitest Patch
workflow Patch
@workflow/world-testing Patch
@workflow/nuxt Patch
@workflow/ai Patch
@workflow/core Patch
@workflow/web-shared Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 7, 2026

🧪 E2E Test Results

Some tests failed

Summary

Passed Failed Skipped Total
✅ ▲ Vercel Production 879 0 67 946
✅ 💻 Local Development 854 0 178 1032
✅ 📦 Local Production 854 0 178 1032
✅ 🐘 Local Postgres 854 0 178 1032
✅ 🪟 Windows 78 0 8 86
❌ 🌍 Community Worlds 16 60 8 84
✅ 📋 Other 216 0 42 258
Total 3751 60 659 4470

❌ Failed Tests

🌍 Community Worlds (60 failed)

mongodb-dev (1 failed):

  • dev e2e should rebuild on imported step dependency change

redis-dev (1 failed):

  • dev e2e should rebuild on imported step dependency change

turso-dev (1 failed):

  • dev e2e should rebuild on imported step dependency change

turso (57 failed):

  • addTenWorkflow | wrun_01KNMT222BNX7Q0QWAV4PS9HEV
  • addTenWorkflow | wrun_01KNMT222BNX7Q0QWAV4PS9HEV
  • wellKnownAgentWorkflow (.well-known/agent) | wrun_01KNMT4GT8YG9KYJG2315P63T6
  • should work with react rendering in step
  • promiseAllWorkflow | wrun_01KNMT28K6AJHPCZQPNFAWYS0Q
  • promiseRaceWorkflow | wrun_01KNMT2CY2GNDENZ276992B22F
  • promiseAnyWorkflow | wrun_01KNMT2F1H3Y5T34W0R52P6V9G
  • importedStepOnlyWorkflow | wrun_01KNMT4T0M03GVV0FB4J2C6WEV
  • hookWorkflow | wrun_01KNMT2V1BNPZN2YQ089T4MW0Q
  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KNMT36FAHA84AV7FBZC1STFV
  • webhookWorkflow | wrun_01KNMT3F464X7PFY6P26H0XGFK
  • sleepingWorkflow | wrun_01KNMT3QSBKZGQJVR2T0VC366P
  • parallelSleepWorkflow | wrun_01KNMT43Z2NGTHPT3247PGVR8T
  • nullByteWorkflow | wrun_01KNMT47Q2WMHFJD4W2DYH55W8
  • workflowAndStepMetadataWorkflow | wrun_01KNMT49S9QP4QZW8H333JAWY9
  • fetchWorkflow | wrun_01KNMT75RVB8CXDBZ22VZFK5AZ
  • promiseRaceStressTestWorkflow | wrun_01KNMT79577Z1G2GHB4CNT2VRQ
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling retry behavior RetryableError respects custom retryAfter delay
  • error handling retry behavior maxRetries=0 disables retries
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • error handling not registered WorkflowNotRegisteredError fails the run when workflow does not exist
  • error handling not registered StepNotRegisteredError fails the step but workflow can catch it
  • error handling not registered StepNotRegisteredError fails the run when not caught in workflow
  • hookCleanupTestWorkflow - hook token reuse after workflow completion | wrun_01KNMTAQ9R2ZZZDMPWRXDA1X85
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KNMTBBRQAYSRBPBSAGEXKGZV
  • hookDisposeTestWorkflow - hook token reuse after explicit disposal while workflow still running | wrun_01KNMTC0E7Y1ME17BND51NGDCR
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars) | wrun_01KNMTCN9G9TR99M0MMTJTDRD6
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument | wrun_01KNMTCY40V5E4G1RQKM1RC4SA
  • closureVariableWorkflow - nested step functions with closure variables | wrun_01KNMTD3P8CCD46CWNG9QTTQNK
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step | wrun_01KNMTD5RMXM21AP6DNZ0JZ0ZJ
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly | wrun_01KNMTDMWMHPVYN4232WQ4F1G2
  • Calculator.calculate - static workflow method using static step methods from another class | wrun_01KNMTDT9YBGTRQW8XVNZQR0PN
  • AllInOneService.processNumber - static workflow method using sibling static step methods | wrun_01KNMTE0V23PHDS5QRWF4PHB6Q
  • ChainableService.processWithThis - static step methods using this to reference the class | wrun_01KNMTE7G4WKK30R7Z7YZVDDKK
  • thisSerializationWorkflow - step function invoked with .call() and .apply() | wrun_01KNMTEDYWE98TGA75V19R0RK6
  • customSerializationWorkflow - custom class serialization with WORKFLOW_SERIALIZE/WORKFLOW_DESERIALIZE | wrun_01KNMTEN8YJ6XPEKYPDTKV11CD
  • instanceMethodStepWorkflow - instance methods with "use step" directive | wrun_01KNMTEWBCEN9EJS4XNH50QPSW
  • crossContextSerdeWorkflow - classes defined in step code are deserializable in workflow context | wrun_01KNMTF7P630JXPJ2K8282HPR6
  • stepFunctionAsStartArgWorkflow - step function reference passed as start() argument | wrun_01KNMTFFHRM5J3QC3DF89YHSK8
  • cancelRun - cancelling a running workflow | wrun_01KNMTFP9SPHY3EACX0ZV4VDR9
  • cancelRun via CLI - cancelling a running workflow | wrun_01KNMTFZ97ZJCD5J2F3YN90SNX
  • pages router addTenWorkflow via pages router
  • pages router promiseAllWorkflow via pages router
  • pages router sleepingWorkflow via pages router
  • hookWithSleepWorkflow - hook payloads delivered correctly with concurrent sleep | wrun_01KNMTGBHZJXWP76R53JASDAHV
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_01KNMTGZRWXMF4E77BJ3NTEXDY
  • sleepWithSequentialStepsWorkflow - sequential steps work with concurrent sleep (control) | wrun_01KNMTH9TQTADV6T95KJH34TPR
  • importMetaUrlWorkflow - import.meta.url is available in step bundles | wrun_01KNMTHGARE4CXWBP10RT5D44B
  • metadataFromHelperWorkflow - getWorkflowMetadata/getStepMetadata work from module-level helper (#1577) | wrun_01KNMTHJBTF931YGA429QY07JD
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_01KNMTHMCWJ3D9W9EQ97SDT9VN

Details by Category

✅ ▲ Vercel Production
App Passed Failed Skipped
✅ astro 79 0 7
✅ example 79 0 7
✅ express 79 0 7
✅ fastify 79 0 7
✅ hono 79 0 7
✅ nextjs-turbopack 84 0 2
✅ nextjs-webpack 84 0 2
✅ nitro 79 0 7
✅ nuxt 79 0 7
✅ sveltekit 79 0 7
✅ vite 79 0 7
✅ 💻 Local Development
App Passed Failed Skipped
✅ astro-stable 72 0 14
✅ express-stable 72 0 14
✅ fastify-stable 72 0 14
✅ hono-stable 72 0 14
✅ nextjs-turbopack-canary 61 0 25
✅ nextjs-turbopack-stable 78 0 8
✅ nextjs-webpack-canary 61 0 25
✅ nextjs-webpack-stable 78 0 8
✅ nitro-stable 72 0 14
✅ nuxt-stable 72 0 14
✅ sveltekit-stable 72 0 14
✅ vite-stable 72 0 14
✅ 📦 Local Production
App Passed Failed Skipped
✅ astro-stable 72 0 14
✅ express-stable 72 0 14
✅ fastify-stable 72 0 14
✅ hono-stable 72 0 14
✅ nextjs-turbopack-canary 61 0 25
✅ nextjs-turbopack-stable 78 0 8
✅ nextjs-webpack-canary 61 0 25
✅ nextjs-webpack-stable 78 0 8
✅ nitro-stable 72 0 14
✅ nuxt-stable 72 0 14
✅ sveltekit-stable 72 0 14
✅ vite-stable 72 0 14
✅ 🐘 Local Postgres
App Passed Failed Skipped
✅ astro-stable 72 0 14
✅ express-stable 72 0 14
✅ fastify-stable 72 0 14
✅ hono-stable 72 0 14
✅ nextjs-turbopack-canary 61 0 25
✅ nextjs-turbopack-stable 78 0 8
✅ nextjs-webpack-canary 61 0 25
✅ nextjs-webpack-stable 78 0 8
✅ nitro-stable 72 0 14
✅ nuxt-stable 72 0 14
✅ sveltekit-stable 72 0 14
✅ vite-stable 72 0 14
✅ 🪟 Windows
App Passed Failed Skipped
✅ nextjs-turbopack 78 0 8
❌ 🌍 Community Worlds
App Passed Failed Skipped
❌ mongodb-dev 4 1 0
❌ redis-dev 4 1 0
❌ turso-dev 4 1 0
❌ turso 4 57 8
✅ 📋 Other
App Passed Failed Skipped
✅ e2e-local-dev-nest-stable 72 0 14
✅ e2e-local-postgres-nest-stable 72 0 14
✅ e2e-local-prod-nest-stable 72 0 14

📋 View full workflow run

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 7, 2026

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 0.042s (-1.0%) 1.006s (~) 0.964s 10 1.00x
💻 Local Nitro 0.043s (-4.1%) 1.006s (~) 0.963s 10 1.02x
💻 Local Next.js (Turbopack) 0.045s 1.005s 0.960s 10 1.08x
🐘 Postgres Next.js (Turbopack) 0.056s 1.010s 0.954s 10 1.35x
🐘 Postgres Nitro 0.056s (-8.0% 🟢) 1.011s (~) 0.955s 10 1.35x
🐘 Postgres Express 0.061s (+10.1% 🔺) 1.010s (~) 0.949s 10 1.46x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 0.225s (-17.2% 🟢) 1.833s (-26.2% 🟢) 1.609s 10 1.00x
▲ Vercel Express 0.238s (-5.9% 🟢) 2.071s (-20.5% 🟢) 1.833s 10 1.06x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -

🔍 Observability: Nitro | Express

workflow with 1 step

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Next.js (Turbopack) 1.117s 2.005s 0.888s 10 1.00x
💻 Local Nitro 1.126s (~) 2.006s (~) 0.880s 10 1.01x
💻 Local Express 1.130s (+0.6%) 2.006s (~) 0.876s 10 1.01x
🐘 Postgres Next.js (Turbopack) 1.135s 2.009s 0.874s 10 1.02x
🐘 Postgres Nitro 1.146s (~) 2.009s (~) 0.863s 10 1.03x
🐘 Postgres Express 1.151s (~) 2.010s (~) 0.859s 10 1.03x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 1.918s (~) 3.227s (-13.8% 🟢) 1.309s 10 1.00x
▲ Vercel Nitro 1.980s (+3.2%) 3.313s (-14.8% 🟢) 1.333s 10 1.03x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -

🔍 Observability: Express | Nitro

workflow with 10 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Next.js (Turbopack) 10.795s 11.022s 0.228s 3 1.00x
🐘 Postgres Next.js (Turbopack) 10.831s 11.020s 0.189s 3 1.00x
🐘 Postgres Nitro 10.922s (~) 11.022s (~) 0.100s 3 1.01x
🐘 Postgres Express 10.931s (~) 11.027s (~) 0.095s 3 1.01x
💻 Local Nitro 10.932s (-0.7%) 11.024s (-2.9%) 0.092s 3 1.01x
💻 Local Express 10.965s (+0.6%) 11.023s (~) 0.058s 3 1.02x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 17.128s (+1.3%) 18.924s (~) 1.795s 2 1.00x
▲ Vercel Express 17.177s (+1.1%) 18.608s (-1.9%) 1.430s 2 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -

🔍 Observability: Nitro | Express

workflow with 25 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 14.439s 15.024s 0.585s 4 1.00x
💻 Local Next.js (Turbopack) 14.597s 15.029s 0.432s 4 1.01x
🐘 Postgres Nitro 14.602s (~) 15.022s (~) 0.420s 4 1.01x
🐘 Postgres Express 14.665s (~) 15.028s (~) 0.363s 4 1.02x
💻 Local Express 14.945s (~) 15.030s (~) 0.085s 4 1.04x
💻 Local Nitro 14.996s (~) 15.279s (-3.2%) 0.283s 4 1.04x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 32.103s (+4.7%) 33.977s (+6.1% 🔺) 1.873s 2 1.00x
▲ Vercel Express 32.500s (+5.0% 🔺) 33.640s (+2.5%) 1.140s 2 1.01x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -

🔍 Observability: Nitro | Express

workflow with 50 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 13.834s 14.018s 0.184s 7 1.00x
🐘 Postgres Nitro 14.079s (~) 14.739s (~) 0.660s 7 1.02x
🐘 Postgres Express 14.163s (+0.6%) 15.023s (+1.0%) 0.860s 6 1.02x
💻 Local Next.js (Turbopack) 15.818s 16.027s 0.209s 6 1.14x
💻 Local Express 16.512s (~) 17.200s (+1.0%) 0.689s 6 1.19x
💻 Local Nitro 16.751s (-1.4%) 17.031s (-1.9%) 0.280s 6 1.21x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 53.023s (-2.4%) 54.470s (-2.6%) 1.447s 2 1.00x
▲ Vercel Nitro 57.175s (+3.8%) 58.541s (+2.2%) 1.366s 2 1.08x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -

🔍 Observability: Express | Nitro

Promise.all with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 1.227s 2.009s 0.782s 15 1.00x
🐘 Postgres Express 1.250s (-1.1%) 2.009s (~) 0.760s 15 1.02x
🐘 Postgres Nitro 1.266s (-0.9%) 2.010s (~) 0.744s 15 1.03x
💻 Local Next.js (Turbopack) 1.500s 2.005s 0.505s 15 1.22x
💻 Local Express 1.533s (-1.6%) 2.005s (-3.3%) 0.472s 15 1.25x
💻 Local Nitro 1.548s (~) 2.006s (~) 0.458s 15 1.26x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.052s (-13.1% 🟢) 3.423s (-22.1% 🟢) 1.370s 9 1.00x
▲ Vercel Nitro 2.109s (-15.0% 🟢) 3.709s (-16.1% 🟢) 1.599s 9 1.03x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -

🔍 Observability: Express | Nitro

Promise.all with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 2.340s (~) 3.009s (~) 0.669s 10 1.00x
🐘 Postgres Next.js (Turbopack) 2.379s 3.010s 0.631s 10 1.02x
🐘 Postgres Nitro 2.395s (+2.0%) 3.008s (~) 0.613s 10 1.02x
💻 Local Next.js (Turbopack) 2.652s 3.107s 0.456s 10 1.13x
💻 Local Express 3.025s (+6.7% 🔺) 3.676s (+18.3% 🔺) 0.652s 9 1.29x
💻 Local Nitro 3.174s (+0.6%) 3.887s (-3.1%) 0.713s 8 1.36x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 2.593s (+1.2%) 3.947s (-8.0% 🟢) 1.354s 8 1.00x
▲ Vercel Express 2.896s (+6.7% 🔺) 4.359s (-5.8% 🟢) 1.463s 7 1.12x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -

🔍 Observability: Nitro | Express

Promise.all with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 3.481s (~) 4.009s (~) 0.529s 8 1.00x
🐘 Postgres Nitro 3.487s (+0.6%) 4.018s (~) 0.531s 8 1.00x
🐘 Postgres Next.js (Turbopack) 3.642s 4.009s 0.367s 8 1.05x
💻 Local Next.js (Turbopack) 7.621s 8.266s 0.645s 4 2.19x
💻 Local Express 7.681s (-5.1% 🟢) 8.020s (-5.9% 🟢) 0.339s 4 2.21x
💻 Local Nitro 8.533s (-4.6%) 9.276s (~) 0.743s 4 2.45x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.580s (-20.8% 🟢) 4.236s (-17.3% 🟢) 1.655s 8 1.00x
▲ Vercel Nitro 2.806s (-5.2% 🟢) 4.319s (-14.6% 🟢) 1.513s 7 1.09x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -

🔍 Observability: Express | Nitro

Promise.race with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 1.212s 2.009s 0.797s 15 1.00x
🐘 Postgres Express 1.263s (+1.0%) 2.008s (~) 0.745s 15 1.04x
🐘 Postgres Nitro 1.264s (+1.0%) 2.007s (~) 0.743s 15 1.04x
💻 Local Next.js (Turbopack) 1.480s 2.005s 0.525s 15 1.22x
💻 Local Express 1.524s (+1.1%) 2.005s (~) 0.482s 15 1.26x
💻 Local Nitro 1.581s (+0.9%) 2.006s (~) 0.426s 15 1.30x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 2.189s (+4.9%) 3.558s (-4.1%) 1.369s 9 1.00x
▲ Vercel Express 2.509s (+18.1% 🔺) 4.123s (+5.9% 🔺) 1.614s 8 1.15x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -

🔍 Observability: Nitro | Express

Promise.race with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 2.325s (~) 3.009s (~) 0.685s 10 1.00x
🐘 Postgres Nitro 2.336s (~) 3.010s (~) 0.674s 10 1.00x
🐘 Postgres Next.js (Turbopack) 2.361s 3.009s 0.647s 10 1.02x
💻 Local Next.js (Turbopack) 2.839s 3.342s 0.502s 9 1.22x
💻 Local Express 2.911s (-17.5% 🟢) 3.342s (-22.3% 🟢) 0.431s 9 1.25x
💻 Local Nitro 3.089s (-1.8%) 3.885s (-3.1%) 0.796s 8 1.33x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 2.523s (~) 4.051s (-5.8% 🟢) 1.527s 8 1.00x
▲ Vercel Express 3.318s (+31.2% 🔺) 4.704s (+1.9%) 1.385s 7 1.32x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -

🔍 Observability: Nitro | Express

Promise.race with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 3.457s (~) 4.012s (~) 0.555s 8 1.00x
🐘 Postgres Express 3.480s (+0.7%) 4.011s (~) 0.531s 8 1.01x
🐘 Postgres Next.js (Turbopack) 3.615s 4.012s 0.397s 8 1.05x
💻 Local Next.js (Turbopack) 7.513s 8.020s 0.507s 4 2.17x
💻 Local Express 7.978s (-9.7% 🟢) 8.275s (-10.8% 🟢) 0.297s 4 2.31x
💻 Local Nitro 9.097s (-2.2%) 9.275s (-7.5% 🟢) 0.178s 4 2.63x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 3.006s (+4.4%) 4.575s (-1.3%) 1.569s 7 1.00x
▲ Vercel Nitro 3.160s (+2.7%) 4.511s (-2.2%) 1.350s 7 1.05x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -

🔍 Observability: Express | Nitro

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.762s 1.006s 0.244s 60 1.00x
💻 Local Next.js (Turbopack) 0.817s 1.004s 0.187s 60 1.07x
🐘 Postgres Express 0.830s (-6.9% 🟢) 1.008s (-4.8%) 0.179s 60 1.09x
🐘 Postgres Nitro 0.837s (-0.8%) 1.006s (~) 0.170s 60 1.10x
💻 Local Nitro 0.990s (-2.5%) 1.181s (-34.4% 🟢) 0.191s 51 1.30x
💻 Local Express 1.008s (+3.5%) 1.627s (+45.9% 🔺) 0.619s 37 1.32x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 9.581s (+5.3% 🔺) 11.145s (~) 1.564s 6 1.00x
▲ Vercel Nitro 9.949s (+5.6% 🔺) 11.274s (-1.2%) 1.325s 6 1.04x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -

🔍 Observability: Express | Nitro

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 1.869s 2.052s 0.183s 44 1.00x
🐘 Postgres Express 2.004s (+1.5%) 2.507s (+8.3% 🔺) 0.503s 36 1.07x
🐘 Postgres Nitro 2.051s (+1.0%) 2.797s (-0.9%) 0.745s 33 1.10x
💻 Local Next.js (Turbopack) 2.596s 3.007s 0.412s 30 1.39x
💻 Local Nitro 3.041s (-1.5%) 3.729s (-7.0% 🟢) 0.688s 25 1.63x
💻 Local Express 3.212s (+8.0% 🔺) 3.649s (+12.0% 🔺) 0.437s 25 1.72x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 27.888s (-7.2% 🟢) 30.009s (-6.5% 🟢) 2.121s 3 1.00x
▲ Vercel Express 27.906s (-3.1%) 29.245s (-4.2%) 1.339s 4 1.00x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -

🔍 Observability: Nitro | Express

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 3.857s 4.147s 0.291s 29 1.00x
🐘 Postgres Express 4.108s (+0.8%) 4.931s (+5.7% 🔺) 0.823s 25 1.07x
🐘 Postgres Nitro 4.112s (-1.5%) 4.931s (-1.6%) 0.819s 25 1.07x
💻 Local Next.js (Turbopack) 8.408s 9.017s 0.609s 14 2.18x
💻 Local Express 8.856s (-2.3%) 9.248s (-3.2%) 0.392s 13 2.30x
💻 Local Nitro 9.250s (-1.9%) 10.019s (~) 0.769s 12 2.40x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 74.150s (-1.1%) 75.702s (-1.2%) 1.551s 2 1.00x
▲ Vercel Nitro 79.461s (+7.3% 🔺) 80.831s (+5.9% 🔺) 1.370s 2 1.07x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -

🔍 Observability: Express | Nitro

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.256s 1.007s 0.751s 60 1.00x
🐘 Postgres Express 0.279s (+0.7%) 1.007s (~) 0.727s 60 1.09x
🐘 Postgres Nitro 0.280s (-1.9%) 1.007s (~) 0.727s 60 1.09x
💻 Local Next.js (Turbopack) 0.541s 1.004s 0.463s 60 2.11x
💻 Local Express 0.573s (-3.9%) 1.004s (~) 0.432s 60 2.24x
💻 Local Nitro 0.587s (-5.8% 🟢) 1.005s (-1.7%) 0.418s 60 2.29x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 1.475s (-24.7% 🟢) 2.833s (-34.8% 🟢) 1.357s 22 1.00x
▲ Vercel Nitro 1.590s (+8.6% 🔺) 3.170s (-1.8%) 1.580s 19 1.08x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -

🔍 Observability: Express | Nitro

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.485s 1.018s 0.533s 89 1.00x
🐘 Postgres Express 0.492s (+1.2%) 1.006s (~) 0.514s 90 1.02x
🐘 Postgres Nitro 0.505s (~) 1.007s (~) 0.502s 90 1.04x
💻 Local Express 2.362s (-5.3% 🟢) 3.009s (~) 0.646s 30 4.87x
💻 Local Next.js (Turbopack) 2.511s 3.009s 0.497s 30 5.18x
💻 Local Nitro 2.542s (-2.0%) 3.010s (~) 0.467s 30 5.24x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 2.496s (-8.6% 🟢) 4.155s (-8.4% 🟢) 1.658s 22 1.00x
▲ Vercel Express 2.829s (+1.4%) 4.337s (-8.4% 🟢) 1.508s 21 1.13x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -

🔍 Observability: Nitro | Express

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.756s 1.006s 0.250s 120 1.00x
🐘 Postgres Express 0.787s (-1.9%) 1.008s (~) 0.221s 120 1.04x
🐘 Postgres Nitro 0.790s (-1.3%) 1.016s (~) 0.226s 119 1.05x
💻 Local Express 10.408s (-5.7% 🟢) 11.027s (-4.0%) 0.619s 11 13.77x
💻 Local Next.js (Turbopack) 10.582s 11.205s 0.623s 11 14.00x
💻 Local Nitro 11.297s (-2.2%) 11.939s (-0.8%) 0.642s 11 14.94x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 6.845s (+4.3%) 8.238s (-1.5%) 1.393s 15 1.00x
▲ Vercel Express 7.644s (+26.8% 🔺) 9.128s (+17.9% 🔺) 1.483s 15 1.12x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - -

🔍 Observability: Nitro | Express

Stream Benchmarks (includes TTFB metrics)
workflow with stream

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Next.js (Turbopack) 0.164s 1.003s 0.011s 1.017s 0.853s 10 1.00x
🐘 Postgres Next.js (Turbopack) 0.185s 1.000s 0.001s 1.010s 0.825s 10 1.13x
💻 Local Nitro 0.203s (-5.1% 🟢) 1.004s (~) 0.012s (-6.2% 🟢) 1.018s (~) 0.815s 10 1.24x
🐘 Postgres Express 0.205s (+1.0%) 0.999s (~) 0.002s (+25.0% 🔺) 1.010s (~) 0.805s 10 1.25x
🐘 Postgres Nitro 0.218s (+8.4% 🔺) 0.995s (~) 0.001s (-35.3% 🟢) 1.009s (~) 0.792s 10 1.33x
💻 Local Express 0.224s (+11.8% 🔺) 1.004s (~) 0.010s (-12.8% 🟢) 1.016s (~) 0.792s 10 1.37x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 1.518s (-12.4% 🟢) 2.956s (+9.5% 🔺) 0.368s (-42.0% 🟢) 3.675s (-8.2% 🟢) 2.156s 10 1.00x
▲ Vercel Express 1.586s (-37.8% 🟢) 2.962s (-27.4% 🟢) 0.348s (+35.8% 🔺) 3.673s (-23.1% 🟢) 2.087s 10 1.04x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - - -

🔍 Observability: Nitro | Express

stream pipeline with 5 transform steps (1MB)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.600s 1.009s 0.005s 1.023s 0.423s 59 1.00x
🐘 Postgres Nitro 0.622s (+1.0%) 1.002s (~) 0.004s (-5.9% 🟢) 1.021s (~) 0.399s 59 1.04x
🐘 Postgres Express 0.624s (-4.5%) 1.002s (~) 0.004s (-25.0% 🟢) 1.023s (~) 0.398s 59 1.04x
💻 Local Next.js (Turbopack) 0.636s 1.012s 0.009s 1.023s 0.388s 59 1.06x
💻 Local Express 0.765s (-5.0%) 1.012s (~) 0.009s (-10.9% 🟢) 1.022s (-8.4% 🟢) 0.257s 59 1.28x
💻 Local Nitro 0.824s (+7.8% 🔺) 1.012s (~) 0.010s (-3.4%) 1.116s (+9.0% 🔺) 0.292s 54 1.37x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 4.084s (-5.6% 🟢) 5.425s (-9.4% 🟢) 0.314s (+8.5% 🔺) 6.059s (-9.6% 🟢) 1.975s 10 1.00x
▲ Vercel Nitro 4.390s (+16.9% 🔺) 5.606s (+4.7%) 0.744s (+167.3% 🔺) 6.744s (+11.4% 🔺) 2.354s 9 1.07x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - - -

🔍 Observability: Express | Nitro

10 parallel streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Next.js (Turbopack) 0.902s 1.074s 0.000s 1.091s 0.189s 55 1.00x
🐘 Postgres Nitro 0.937s (-1.4%) 1.102s (-5.3% 🟢) 0.000s (-25.7% 🟢) 1.115s (-5.8% 🟢) 0.178s 56 1.04x
🐘 Postgres Express 0.957s (+1.2%) 1.246s (+2.1%) 0.000s (-100.0% 🟢) 1.258s (+2.0%) 0.300s 48 1.06x
💻 Local Next.js (Turbopack) 1.230s 2.019s 0.000s 2.022s 0.793s 30 1.36x
💻 Local Nitro 1.238s (-5.3% 🟢) 2.022s (~) 0.000s (-50.0% 🟢) 2.024s (~) 0.786s 30 1.37x
💻 Local Express 1.242s (-11.5% 🟢) 2.023s (~) 0.000s (+16.7% 🔺) 2.025s (-8.0% 🟢) 0.782s 30 1.38x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.791s (+10.1% 🔺) 4.065s (+4.8%) 0.000s (-100.0% 🟢) 4.416s (-1.8%) 1.625s 14 1.00x
▲ Vercel Nitro 2.825s (+6.0% 🔺) 3.733s (-8.0% 🟢) 0.000s (-13.3% 🟢) 4.168s (-9.7% 🟢) 1.343s 15 1.01x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - - -

🔍 Observability: Express | Nitro

fan-out fan-in 10 streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 1.742s (~) 2.141s (+3.5%) 0.000s (-100.0% 🟢) 2.165s (+2.6%) 0.422s 28 1.00x
🐘 Postgres Express 1.779s (+2.0%) 2.102s (~) 0.000s (-50.0% 🟢) 2.114s (~) 0.335s 29 1.02x
🐘 Postgres Next.js (Turbopack) 1.832s 2.181s 0.000s 2.188s 0.356s 28 1.05x
💻 Local Next.js (Turbopack) 3.509s 4.032s 0.001s 4.036s 0.527s 15 2.01x
💻 Local Nitro 3.528s (-5.4% 🟢) 4.097s (~) 0.001s (+71.4% 🔺) 4.100s (~) 0.572s 15 2.02x
💻 Local Express 3.536s (+3.1%) 4.034s (+1.6%) 0.001s (+20.0% 🔺) 4.037s (+1.6%) 0.501s 15 2.03x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 3.784s (-9.4% 🟢) 5.071s (-9.2% 🟢) 0.000s (+Infinity% 🔺) 5.402s (-10.8% 🟢) 1.617s 12 1.00x
▲ Vercel Nitro 5.285s (+41.6% 🔺) 6.549s (+33.0% 🔺) 0.000s (-100.0% 🟢) 7.209s (+35.3% 🔺) 1.924s 9 1.40x
▲ Vercel Next.js (Turbopack) ⚠️ missing - - - - -

🔍 Observability: Express | Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World 🥇 Fastest Framework Wins
💻 Local Next.js (Turbopack) 18/21
🐘 Postgres Next.js (Turbopack) 16/21
▲ Vercel Express 11/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework 🥇 Fastest World Wins
Express 🐘 Postgres 17/21
Next.js (Turbopack) 🐘 Postgres 17/21
Nitro 🐘 Postgres 16/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant