Skip to content

Improve backport workflow: auto-resolve docs and lockfile conflicts, add DCO signoff#1770

Merged
TooTallNate merged 7 commits into
mainfrom
backport-auto-resolve-docs-and-lockfile
Apr 16, 2026
Merged

Improve backport workflow: auto-resolve docs and lockfile conflicts, add DCO signoff#1770
TooTallNate merged 7 commits into
mainfrom
backport-auto-resolve-docs-and-lockfile

Conversation

@TooTallNate
Copy link
Copy Markdown
Member

@TooTallNate TooTallNate commented Apr 16, 2026

Summary

  • Auto-resolve docs app conflicts (files under docs/ except docs/content/) during backport cherry-picks by deleting them, since the docs app is not maintained on stable
  • Preserve docs/content/ conflicts for normal resolution, since those markdown files are bundled into npm packages via prepack scripts
  • Auto-resolve pnpm-lock.yaml conflicts by running pnpm install (which resolves lockfile merge conflicts natively)
  • If these resolve all conflicts, the cherry-pick pushes directly to stable without needing AI or a separate PR
  • Add --signoff to git cherry-pick so backport commits pass the DCO check
  • Set up pnpm/Node.js before the cherry-pick step so pnpm install is available during conflict resolution
  • Update the AI prompt for remaining conflicts to know about the docs app vs. docs/content/ distinction
  • Update AGENTS.md to document the policy

Note: #1771 should be merged first — it removes the docs app from stable and establishes the docs/content/-only directory structure that this workflow relies on.

The docs/ directory is not maintained on the stable branch. When cherry-picking
from main to stable, any conflicts in docs/ files are now auto-resolved by
deleting them. Lockfile conflicts are resolved by re-running pnpm install.
If these resolve all conflicts, the cherry-pick pushes directly to stable
without needing AI resolution or a separate PR.
Copilot AI review requested due to automatic review settings April 16, 2026 05:59
@TooTallNate TooTallNate requested a review from a team as a code owner April 16, 2026 05:59
@vercel
Copy link
Copy Markdown
Contributor

vercel Bot commented Apr 16, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
example-nextjs-workflow-turbopack Ready Ready Preview, Comment Apr 16, 2026 8:50pm
example-nextjs-workflow-webpack Ready Ready Preview, Comment Apr 16, 2026 8:50pm
example-workflow Ready Ready Preview, Comment Apr 16, 2026 8:50pm
workbench-astro-workflow Ready Ready Preview, Comment Apr 16, 2026 8:50pm
workbench-express-workflow Ready Ready Preview, Comment Apr 16, 2026 8:50pm
workbench-fastify-workflow Ready Ready Preview, Comment Apr 16, 2026 8:50pm
workbench-hono-workflow Ready Ready Preview, Comment Apr 16, 2026 8:50pm
workbench-nitro-workflow Ready Ready Preview, Comment Apr 16, 2026 8:50pm
workbench-nuxt-workflow Ready Ready Preview, Comment Apr 16, 2026 8:50pm
workbench-sveltekit-workflow Ready Ready Preview, Comment Apr 16, 2026 8:50pm
workbench-vite-workflow Ready Ready Preview, Comment Apr 16, 2026 8:50pm
workflow-docs Ready Ready Preview, Comment, Open in v0 Apr 16, 2026 8:50pm
workflow-swc-playground Ready Ready Preview, Comment Apr 16, 2026 8:50pm
workflow-web Ready Ready Preview, Comment Apr 16, 2026 8:50pm

@changeset-bot
Copy link
Copy Markdown

changeset-bot Bot commented Apr 16, 2026

⚠️ No Changeset found

Latest commit: 149ed34

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026

🧪 E2E Test Results

Some tests failed

Summary

Passed Failed Skipped Total
❌ ▲ Vercel Production 919 4 67 990
✅ 💻 Local Development 994 0 86 1080
✅ 📦 Local Production 994 0 86 1080
✅ 🐘 Local Postgres 994 0 86 1080
✅ 🪟 Windows 90 0 0 90
❌ 🌍 Community Worlds 133 98 0 231
✅ 📋 Other 252 0 18 270
Total 4376 102 343 4821

❌ Failed Tests

▲ Vercel Production (4 failed)

express (1 failed):

  • outputStreamInsideStepWorkflow - getWritable() called inside step functions | wrun_01KPC104J28ABHGKBACTGX0R0J | 🔍 observability

fastify (2 failed):

  • outputStreamWorkflow negative startIndex (reads from end)
  • outputStreamWorkflow - getTailIndex and getChunks getChunks returns same content as reading the stream

sveltekit (1 failed):

  • outputStreamWorkflow negative startIndex (reads from end)
🌍 Community Worlds (98 failed)

mongodb (15 failed):

  • readableStreamWorkflow | wrun_01KPC0VJPBB4509CQC4S3R2V0G
  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KPC0W973GSHQ1FY6EWHRNA0C
  • webhookWorkflow | wrun_01KPC0WJ64Z4QVYYBZR6P4FZAY
  • outputStreamWorkflow no startIndex (reads all chunks)
  • outputStreamWorkflow positive startIndex (skips first chunk)
  • outputStreamWorkflow negative startIndex (reads from end)
  • outputStreamWorkflow - getTailIndex and getChunks getTailIndex returns correct index after stream completes
  • outputStreamWorkflow - getTailIndex and getChunks getTailIndex returns -1 before any chunks are written
  • outputStreamWorkflow - getTailIndex and getChunks getChunks returns same content as reading the stream
  • outputStreamInsideStepWorkflow - getWritable() called inside step functions | wrun_01KPC104J28ABHGKBACTGX0R0J
  • fetchWorkflow | wrun_01KPC10HY2VNRHX1ZQ6J88C3ZG
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KPC162FJEQSCD601VXNWFX21
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • health check (CLI) - workflow health command reports healthy endpoints
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_01KPC1D5MCFDQ5DV5455Y92R51

redis (15 failed):

  • readableStreamWorkflow | wrun_01KPC0VJPBB4509CQC4S3R2V0G
  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KPC0W973GSHQ1FY6EWHRNA0C
  • webhookWorkflow | wrun_01KPC0WJ64Z4QVYYBZR6P4FZAY
  • outputStreamWorkflow no startIndex (reads all chunks)
  • outputStreamWorkflow positive startIndex (skips first chunk)
  • outputStreamWorkflow negative startIndex (reads from end)
  • outputStreamWorkflow - getTailIndex and getChunks getTailIndex returns correct index after stream completes
  • outputStreamWorkflow - getTailIndex and getChunks getTailIndex returns -1 before any chunks are written
  • outputStreamWorkflow - getTailIndex and getChunks getChunks returns same content as reading the stream
  • outputStreamInsideStepWorkflow - getWritable() called inside step functions | wrun_01KPC104J28ABHGKBACTGX0R0J
  • fetchWorkflow | wrun_01KPC10HY2VNRHX1ZQ6J88C3ZG
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KPC162FJEQSCD601VXNWFX21
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • health check (CLI) - workflow health command reports healthy endpoints
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_01KPC1D5MCFDQ5DV5455Y92R51

turso (68 failed):

  • addTenWorkflow | wrun_01KPC0V07C8GT6EHF4ZN3A4S76
  • addTenWorkflow | wrun_01KPC0V07C8GT6EHF4ZN3A4S76
  • wellKnownAgentWorkflow (.well-known/agent) | wrun_01KPC0WBCHFY2X9Q8QQ6RKV99C
  • should work with react rendering in step
  • promiseAllWorkflow | wrun_01KPC0V6ZNMJ97GGD88H7K9N9E
  • promiseRaceWorkflow | wrun_01KPC0VD0Y9YK24MSRJADCK04X
  • promiseAnyWorkflow | wrun_01KPC0VGH5D4CEG7WYC7GGBXS3
  • importedStepOnlyWorkflow | wrun_01KPC0WPGFTBZHC85NN0ZC00J3
  • readableStreamWorkflow | wrun_01KPC0VJPBB4509CQC4S3R2V0G
  • hookWorkflow | wrun_01KPC0VWJSW1XCEBJRJRQZ622Q
  • hookWorkflow is not resumable via public webhook endpoint | wrun_01KPC0W973GSHQ1FY6EWHRNA0C
  • webhookWorkflow | wrun_01KPC0WJ64Z4QVYYBZR6P4FZAY
  • sleepingWorkflow | wrun_01KPC0WR8BDHHH7F8J6YM215RT
  • parallelSleepWorkflow | wrun_01KPC0X5GD213PB0PJMWTR6GW7
  • nullByteWorkflow | wrun_01KPC0X8TFYWPNPW6KY3FWBGR6
  • workflowAndStepMetadataWorkflow | wrun_01KPC0XAYDHF1NWYYDFN5HAK8H
  • outputStreamWorkflow no startIndex (reads all chunks)
  • outputStreamWorkflow positive startIndex (skips first chunk)
  • outputStreamWorkflow negative startIndex (reads from end)
  • outputStreamWorkflow - getTailIndex and getChunks getTailIndex returns correct index after stream completes
  • outputStreamWorkflow - getTailIndex and getChunks getTailIndex returns -1 before any chunks are written
  • outputStreamWorkflow - getTailIndex and getChunks getChunks returns same content as reading the stream
  • outputStreamInsideStepWorkflow - getWritable() called inside step functions | wrun_01KPC104J28ABHGKBACTGX0R0J
  • fetchWorkflow | wrun_01KPC10HY2VNRHX1ZQ6J88C3ZG
  • promiseRaceStressTestWorkflow | wrun_01KPC10M6NQGEGY4GPTBHY8SMD
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling retry behavior RetryableError respects custom retryAfter delay
  • error handling retry behavior maxRetries=0 disables retries
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • error handling not registered WorkflowNotRegisteredError fails the run when workflow does not exist
  • error handling not registered StepNotRegisteredError fails the step but workflow can catch it
  • error handling not registered StepNotRegisteredError fails the run when not caught in workflow
  • hookCleanupTestWorkflow - hook token reuse after workflow completion | wrun_01KPC15DYXKS6D0RFPJF8JEWWN
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_01KPC162FJEQSCD601VXNWFX21
  • hookDisposeTestWorkflow - hook token reuse after explicit disposal while workflow still running | wrun_01KPC16RMF5EKC64H31B3T0KMW
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars) | wrun_01KPC17DP9SAFYCXA6T8V42K20
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument | wrun_01KPC17PV3PDZJWR0XXP5HS41F
  • closureVariableWorkflow - nested step functions with closure variables | wrun_01KPC17WPFT14Z0PNGEPTGF86F
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step | wrun_01KPC17YSNZ64DZ498SJVRS7C9
  • runClassSerializationWorkflow - Run instances serialize across workflow/step boundaries | wrun_01KPC18A0Y7ZK22M3B2GC8YATC
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • health check (CLI) - workflow health command reports healthy endpoints
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly | wrun_01KPC18TNFGW0JYHWEHGGMMSQ9
  • Calculator.calculate - static workflow method using static step methods from another class | wrun_01KPC191QEFXPKWWPRDX3K2XB3
  • AllInOneService.processNumber - static workflow method using sibling static step methods | wrun_01KPC198R0F7RMFKN46CAX21QP
  • ChainableService.processWithThis - static step methods using this to reference the class | wrun_01KPC19G7G7AST3Z2T3J1QTW4V
  • thisSerializationWorkflow - step function invoked with .call() and .apply() | wrun_01KPC19PXN39RB27DCAK2EQBHR
  • customSerializationWorkflow - custom class serialization with WORKFLOW_SERIALIZE/WORKFLOW_DESERIALIZE | wrun_01KPC19YPP9ATVGA506SKVD76B
  • instanceMethodStepWorkflow - instance methods with "use step" directive | wrun_01KPC1AB4HBHK37H0Q1Y5S4ZYZ
  • crossContextSerdeWorkflow - classes defined in step code are deserializable in workflow context | wrun_01KPC1AP7GTZ0J54YXXBWY9F2G
  • stepFunctionAsStartArgWorkflow - step function reference passed as start() argument | wrun_01KPC1AY5MP5NSJX6H4WSY207C
  • cancelRun - cancelling a running workflow | wrun_01KPC1B4V1BKTR7MDHB2ZEGCJP
  • cancelRun via CLI - cancelling a running workflow | wrun_01KPC1BE5EMAEBC6EQD5BJYHHJ
  • pages router addTenWorkflow via pages router
  • pages router promiseAllWorkflow via pages router
  • pages router sleepingWorkflow via pages router
  • hookWithSleepWorkflow - hook payloads delivered correctly with concurrent sleep | wrun_01KPC1BTEHYFBVS4ZXA260BSS7
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_01KPC1CGCJQWS43F2CC2TRCVKE
  • sleepWithSequentialStepsWorkflow - sequential steps work with concurrent sleep (control) | wrun_01KPC1CTMWQ7BV9P8CG3QBEEPS
  • importMetaUrlWorkflow - import.meta.url is available in step bundles | wrun_01KPC1D1DQWY0B81N1094EV0BT
  • metadataFromHelperWorkflow - getWorkflowMetadata/getStepMetadata work from module-level helper (#1577) | wrun_01KPC1D3HH2YEDV2D9P8FZTBVV
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_01KPC1D5MCFDQ5DV5455Y92R51
  • getterStepWorkflow - getter functions with "use step" directive | wrun_01KPC1D8WJ00P6YDP4A55S42Y2

Details by Category

❌ ▲ Vercel Production
App Passed Failed Skipped
✅ astro 83 0 7
✅ example 83 0 7
❌ express 82 1 7
❌ fastify 81 2 7
✅ hono 83 0 7
✅ nextjs-turbopack 88 0 2
✅ nextjs-webpack 88 0 2
✅ nitro 83 0 7
✅ nuxt 83 0 7
❌ sveltekit 82 1 7
✅ vite 83 0 7
✅ 💻 Local Development
App Passed Failed Skipped
✅ astro-stable 84 0 6
✅ express-stable 84 0 6
✅ fastify-stable 84 0 6
✅ hono-stable 84 0 6
✅ nextjs-turbopack-canary 71 0 19
✅ nextjs-turbopack-stable 90 0 0
✅ nextjs-webpack-canary 71 0 19
✅ nextjs-webpack-stable 90 0 0
✅ nitro-stable 84 0 6
✅ nuxt-stable 84 0 6
✅ sveltekit-stable 84 0 6
✅ vite-stable 84 0 6
✅ 📦 Local Production
App Passed Failed Skipped
✅ astro-stable 84 0 6
✅ express-stable 84 0 6
✅ fastify-stable 84 0 6
✅ hono-stable 84 0 6
✅ nextjs-turbopack-canary 71 0 19
✅ nextjs-turbopack-stable 90 0 0
✅ nextjs-webpack-canary 71 0 19
✅ nextjs-webpack-stable 90 0 0
✅ nitro-stable 84 0 6
✅ nuxt-stable 84 0 6
✅ sveltekit-stable 84 0 6
✅ vite-stable 84 0 6
✅ 🐘 Local Postgres
App Passed Failed Skipped
✅ astro-stable 84 0 6
✅ express-stable 84 0 6
✅ fastify-stable 84 0 6
✅ hono-stable 84 0 6
✅ nextjs-turbopack-canary 71 0 19
✅ nextjs-turbopack-stable 90 0 0
✅ nextjs-webpack-canary 71 0 19
✅ nextjs-webpack-stable 90 0 0
✅ nitro-stable 84 0 6
✅ nuxt-stable 84 0 6
✅ sveltekit-stable 84 0 6
✅ vite-stable 84 0 6
✅ 🪟 Windows
App Passed Failed Skipped
✅ nextjs-turbopack 90 0 0
❌ 🌍 Community Worlds
App Passed Failed Skipped
✅ mongodb-dev 6 0 0
❌ mongodb 56 15 0
✅ redis-dev 6 0 0
❌ redis 56 15 0
✅ turso-dev 6 0 0
❌ turso 3 68 0
✅ 📋 Other
App Passed Failed Skipped
✅ e2e-local-dev-nest-stable 84 0 6
✅ e2e-local-postgres-nest-stable 84 0 6
✅ e2e-local-prod-nest-stable 84 0 6

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Apr 16, 2026

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 0.043s (~) 1.005s (~) 0.962s 10 1.00x
🐘 Postgres Express 0.046s (-20.2% 🟢) 1.010s (~) 0.963s 10 1.08x
🐘 Postgres Nitro 0.048s (-49.9% 🟢) 1.009s (-3.2%) 0.961s 10 1.11x
💻 Local Express 0.048s (+8.6% 🔺) 1.005s (~) 0.957s 10 1.12x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 0.247s (+4.8%) 2.478s (+16.0% 🔺) 2.232s 10 1.00x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 1 step

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 1.110s (-2.6%) 2.010s (~) 0.900s 10 1.00x
🐘 Postgres Express 1.111s (-3.1%) 2.010s (~) 0.899s 10 1.00x
💻 Local Nitro 1.129s (~) 2.006s (~) 0.877s 10 1.02x
💻 Local Express 1.139s (+1.2%) 2.007s (~) 0.869s 10 1.03x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.225s (+18.7% 🔺) 4.108s (+7.9% 🔺) 1.883s 10 1.00x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 10 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 10.668s (-1.9%) 11.018s (~) 0.350s 3 1.00x
🐘 Postgres Express 10.690s (-2.5%) 11.024s (~) 0.334s 3 1.00x
💻 Local Express 10.928s (~) 11.023s (~) 0.095s 3 1.02x
💻 Local Nitro 10.942s (~) 11.023s (~) 0.081s 3 1.03x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 43.173s (+154.2% 🔺) 46.138s (+130.5% 🔺) 2.965s 1 1.00x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 25 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 14.034s (-3.8%) 15.025s (~) 0.990s 4 1.00x
🐘 Postgres Nitro 14.063s (-3.6%) 15.021s (~) 0.958s 4 1.00x
💻 Local Nitro 15.003s (~) 15.030s (-6.2% 🟢) 0.027s 4 1.07x
💻 Local Express 15.047s (+0.5%) 15.531s (+3.3%) 0.483s 4 1.07x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 31.691s (-37.0% 🟢) 33.377s (-36.5% 🟢) 1.686s 2 1.00x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 50 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 12.957s (-7.5% 🟢) 13.162s (-9.8% 🟢) 0.205s 7 1.00x
🐘 Postgres Nitro 12.979s (-7.1% 🟢) 13.448s (-6.0% 🟢) 0.468s 7 1.00x
💻 Local Nitro 16.403s (-2.3%) 17.032s (~) 0.628s 6 1.27x
💻 Local Express 16.551s (~) 17.032s (~) 0.481s 6 1.28x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 60.901s (-49.8% 🟢) 63.419s (-48.7% 🟢) 2.518s 2 1.00x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

Promise.all with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.191s (-5.5% 🟢) 2.008s (~) 0.817s 15 1.00x
🐘 Postgres Nitro 1.202s (-5.7% 🟢) 2.008s (~) 0.806s 15 1.01x
💻 Local Nitro 1.518s (-6.9% 🟢) 2.006s (-3.3%) 0.488s 15 1.27x
💻 Local Express 1.520s (+2.1%) 2.006s (~) 0.486s 15 1.28x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 5.678s (+98.5% 🔺) 7.268s (+57.2% 🔺) 1.590s 9 1.00x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

Promise.all with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 2.269s (-3.9%) 3.010s (~) 0.741s 10 1.00x
🐘 Postgres Nitro 2.285s (-2.8%) 3.007s (~) 0.723s 10 1.01x
💻 Local Nitro 2.975s (-5.4% 🟢) 3.208s (-17.4% 🟢) 0.233s 10 1.31x
💻 Local Express 2.981s (+1.0%) 3.342s (-3.2%) 0.361s 9 1.31x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 5.022s (+38.8% 🔺) 6.622s (+29.6% 🔺) 1.600s 6 1.00x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

Promise.all with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 3.370s (-3.1%) 4.010s (~) 0.640s 8 1.00x
🐘 Postgres Express 3.385s (-2.9%) 4.009s (~) 0.624s 8 1.00x
💻 Local Express 7.636s (-8.4% 🟢) 8.022s (-11.1% 🟢) 0.386s 4 2.27x
💻 Local Nitro 7.727s (-7.4% 🟢) 8.273s (-8.3% 🟢) 0.546s 4 2.29x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 4.065s (-4.1%) 5.448s (-11.1% 🟢) 1.383s 6 1.00x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

Promise.race with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.200s (-4.6%) 2.008s (~) 0.808s 15 1.00x
🐘 Postgres Nitro 1.203s (-4.3%) 2.009s (~) 0.806s 15 1.00x
💻 Local Express 1.544s (-18.5% 🟢) 2.006s (-15.1% 🟢) 0.462s 15 1.29x
💻 Local Nitro 1.887s (+1.1%) 2.391s (+2.2%) 0.504s 13 1.57x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.435s (-5.7% 🟢) 3.848s (-11.5% 🟢) 1.413s 8 1.00x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

Promise.race with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 2.263s (-3.3%) 3.008s (~) 0.745s 10 1.00x
🐘 Postgres Express 2.287s (-2.3%) 3.009s (~) 0.722s 10 1.01x
💻 Local Express 2.885s (-7.9% 🟢) 3.007s (-20.1% 🟢) 0.122s 10 1.28x
💻 Local Nitro 2.903s (-5.3% 🟢) 3.565s (-8.3% 🟢) 0.662s 9 1.28x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.900s (-9.2% 🟢) 4.724s (-1.4%) 1.823s 7 1.00x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

Promise.race with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 3.387s (-2.7%) 4.009s (~) 0.622s 8 1.00x
🐘 Postgres Express 3.401s (-2.8%) 4.011s (~) 0.610s 8 1.00x
💻 Local Nitro 8.136s (-11.0% 🟢) 9.023s (-10.0% 🟢) 0.888s 4 2.40x
💻 Local Express 8.393s (-4.6%) 8.773s (-5.4% 🟢) 0.380s 4 2.48x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 4.305s (-32.9% 🟢) 6.474s (-20.8% 🟢) 2.169s 5 1.00x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 0.593s (-27.8% 🟢) 1.006s (~) 0.413s 60 1.00x
🐘 Postgres Express 0.599s (-28.6% 🟢) 1.006s (-1.6%) 0.407s 60 1.01x
💻 Local Nitro 1.003s (+2.3%) 1.544s (+41.1% 🔺) 0.541s 39 1.69x
💻 Local Express 1.044s (+6.1% 🔺) 1.941s (+80.4% 🔺) 0.898s 31 1.76x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 11.521s (-39.4% 🟢) 13.881s (-34.9% 🟢) 2.360s 5 1.00x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 1.425s (-27.9% 🟢) 2.007s (-11.1% 🟢) 0.582s 45 1.00x
🐘 Postgres Nitro 1.431s (-25.7% 🟢) 2.007s (-4.4%) 0.576s 45 1.00x
💻 Local Nitro 3.038s (~) 3.759s (~) 0.721s 24 2.13x
💻 Local Express 3.101s (+2.8%) 3.923s (+9.4% 🔺) 0.822s 23 2.18x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 33.932s (-1.7%) 35.811s (-2.7%) 1.879s 3 1.00x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Express 2.913s (-27.0% 🟢) 3.136s (-28.2% 🟢) 0.223s 39 1.00x
🐘 Postgres Nitro 2.915s (-29.0% 🟢) 3.166s (-31.2% 🟢) 0.251s 38 1.00x
💻 Local Nitro 8.924s (-4.0%) 9.231s (-7.9% 🟢) 0.307s 14 3.06x
💻 Local Express 9.116s (-1.0%) 9.788s (-2.3%) 0.672s 13 3.13x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 119.100s (-8.4% 🟢) 120.838s (-8.6% 🟢) 1.737s 2 1.00x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 0.222s (-21.7% 🟢) 1.006s (~) 0.785s 60 1.00x
🐘 Postgres Express 0.225s (-20.2% 🟢) 1.007s (~) 0.782s 60 1.02x
💻 Local Nitro 0.588s (-2.7%) 1.021s (~) 0.433s 59 2.65x
💻 Local Express 0.603s (+7.6% 🔺) 1.004s (~) 0.401s 60 2.72x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 5.381s (+175.4% 🔺) 7.740s (+112.8% 🔺) 2.359s 8 1.00x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 0.351s (-29.4% 🟢) 1.005s (~) 0.655s 90 1.00x
🐘 Postgres Express 0.357s (-30.0% 🟢) 1.006s (~) 0.649s 90 1.02x
💻 Local Nitro 2.395s (-5.6% 🟢) 3.008s (~) 0.613s 30 6.83x
💻 Local Express 2.756s (+9.7% 🔺) 3.218s (+6.9% 🔺) 0.462s 29 7.86x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 3.582s (+17.6% 🔺) 10.516s (+118.8% 🔺) 6.934s 10 1.00x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 0.557s (-29.5% 🟢) 1.006s (~) 0.449s 120 1.00x
🐘 Postgres Express 0.572s (-30.2% 🟢) 1.007s (-1.1%) 0.435s 120 1.03x
💻 Local Nitro 10.559s (-5.6% 🟢) 11.026s (-5.5% 🟢) 0.467s 11 18.96x
💻 Local Express 11.609s (+3.7%) 12.234s (+2.5%) 0.625s 10 20.85x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 13.967s (+88.2% 🔺) 15.892s (+71.9% 🔺) 1.925s 8 1.00x
▲ Vercel Nitro ⚠️ missing - - - -

🔍 Observability: Express

Stream Benchmarks (includes TTFB metrics)
workflow with stream

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 0.150s (-26.7% 🟢) 1.000s (~) 0.001s (-26.7% 🟢) 1.010s (~) 0.860s 10 1.00x
🐘 Postgres Express 0.155s (-24.5% 🟢) 1.000s (~) 0.001s (-18.8% 🟢) 1.011s (~) 0.856s 10 1.03x
💻 Local Nitro 0.208s (-2.6%) 1.004s (~) 0.010s (-20.0% 🟢) 1.016s (~) 0.808s 10 1.39x
💻 Local Express 0.213s (+6.9% 🔺) 1.004s (~) 0.010s (-15.7% 🟢) 1.016s (~) 0.803s 10 1.42x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 1.764s (-29.6% 🟢) 2.950s (-27.9% 🟢) 2.629s (+173.6% 🔺) 6.181s (+10.6% 🔺) 4.417s 10 1.00x
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Express

stream pipeline with 5 transform steps (1MB)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 0.492s (-21.2% 🟢) 1.006s (~) 0.003s (-17.2% 🟢) 1.019s (~) 0.528s 59 1.00x
🐘 Postgres Express 0.507s (-19.5% 🟢) 1.006s (~) 0.003s (-14.6% 🟢) 1.020s (~) 0.513s 59 1.03x
💻 Local Nitro 0.856s (+2.0%) 1.012s (~) 0.009s (-6.7% 🟢) 1.115s (~) 0.259s 54 1.74x
💻 Local Express 0.973s (+28.5% 🔺) 1.014s (-1.5%) 0.057s (+501.0% 🔺) 1.169s (+12.5% 🔺) 0.196s 52 1.98x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 5.102s (-21.6% 🟢) 6.945s (-13.3% 🟢) 0.491s (+20.1% 🔺) 7.868s (-10.9% 🟢) 2.766s 8 1.00x
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Express

10 parallel streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 0.902s (-6.9% 🟢) 1.051s (-15.7% 🟢) 0.000s (-15.8% 🟢) 1.059s (-15.8% 🟢) 0.157s 57 1.00x
🐘 Postgres Express 0.914s (-4.9%) 1.070s (-16.3% 🟢) 0.000s (+23.2% 🔺) 1.079s (-17.4% 🟢) 0.165s 56 1.01x
💻 Local Express 1.340s (+9.4% 🔺) 2.021s (~) 0.000s (+30.0% 🔺) 2.023s (~) 0.683s 30 1.49x
💻 Local Nitro 1.399s (+14.4% 🔺) 2.020s (~) 0.000s (+185.7% 🔺) 2.201s (+8.9% 🔺) 0.802s 28 1.55x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 6.460s (+72.7% 🔺) 8.194s (+60.6% 🔺) 0.000s (-100.0% 🟢) 8.919s (+61.3% 🔺) 2.459s 8 1.00x
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Express

fan-out fan-in 10 streams (1MB each)

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🐘 Postgres 🥇 Nitro 1.580s (-11.8% 🟢) 2.070s (-3.3%) 0.000s (-100.0% 🟢) 2.077s (-4.5%) 0.497s 29 1.00x
🐘 Postgres Express 1.659s (-6.4% 🟢) 2.138s (-1.8%) 0.000s (+Infinity% 🔺) 2.164s (-1.6%) 0.506s 29 1.05x
💻 Local Nitro 3.393s (~) 4.032s (~) 0.000s (-50.0% 🟢) 4.035s (~) 0.641s 15 2.15x
💻 Local Express 3.790s (+9.3% 🔺) 4.320s (+7.1% 🔺) 0.001s (-37.5% 🟢) 4.324s (+7.1% 🔺) 0.533s 14 2.40x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 6.246s (+36.2% 🔺) 7.476s (+24.1% 🔺) 0.000s (NaN%) 7.943s (+23.0% 🔺) 1.697s 8 1.00x
▲ Vercel Nitro ⚠️ missing - - - - -

🔍 Observability: Express

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World 🥇 Fastest Framework Wins
💻 Local Nitro 16/21
🐘 Postgres Nitro 13/21
▲ Vercel Express 21/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework 🥇 Fastest World Wins
Express 🐘 Postgres 21/21
Nitro 🐘 Postgres 20/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates the backport.yml GitHub Action to automatically resolve common cherry-pick conflicts when backporting merged PRs from main to stable, reflecting the repo policy that docs/ is not maintained on stable.

Changes:

  • Document the docs/-on-stable policy and the backport auto-resolution behavior in AGENTS.md.
  • In the backport workflow, auto-resolve conflicts under docs/ by deleting conflicted files.
  • Auto-resolve pnpm-lock.yaml conflicts by re-running pnpm install, and push directly to stable if no conflicts remain.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 2 comments.

File Description
AGENTS.md Documents the docs/ backport policy and updated conflict-resolution flow for backports to stable.
.github/workflows/backport.yml Adds automatic conflict resolution for docs/ and pnpm-lock.yaml, and updates the AI prompt to reflect the docs policy.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread .github/workflows/backport.yml Outdated
Comment thread .github/workflows/backport.yml Outdated
Comment thread .github/workflows/backport.yml Outdated
Copy link
Copy Markdown
Contributor

@karthikscale3 karthikscale3 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Review

Regression Risk: Low

This PR only modifies CI infrastructure and documentation — no production code, no package code, no runtime behavior changes. The risk surface is limited to the backport workflow itself.

Potential Concerns

1. Dependency on PR #1771 (ordering matters)

The PR description clearly states #1771 should be merged first. If #1770 goes in first and a backport happens before #1771 cleans up stable, the auto-delete logic could remove docs files from stable that are still expected to exist there. Not a blocker if merge order is respected.

2. Duplicate Setup Node.js steps

The new unconditional setup (node-version: 22.x) is added before the cherry-pick, but the old conditional setup (node-version: 'lts/*', line 49) for the opencode step is not removed. This is functionally harmless (the second setup is a near-no-op) but slightly sloppy. The version mismatch (22.x vs lts/*) could theoretically matter if they diverge.

3. Pinned pnpm version

The new step pins version: 10.14.0. If the repo's packageManager field in package.json drifts from this, lockfile resolution could produce unexpected results. Other workflows (e.g., release.yml, tests.yml) may handle this differently — worth confirming they're consistent.

4. pnpm install failure during conflict resolution

If pnpm install --no-frozen-lockfile fails, the entire cherry-pick step fails with no status output. However, this is correctly handled: the "Comment on unexpected failure" step (which checks status != 'clean' && status != 'conflict') will fire and post a useful comment on the PR.

CI Status

All core tests pass. Community Worlds failures (MongoDB, Redis, Turso) are pre-existing and unrelated to this PR.

Verdict

No blockers. Well-thought-out workflow improvement. Review comments from Copilot and Vercel bot were addressed properly. Main thing: #1771 should land first to establish the docs/content/-only structure on stable.

Minor cleanup suggestions (non-blocking):

  • Remove the now-redundant conditional Setup Node.js step (or unify the two)
  • Consider reading the pnpm version from package.json's packageManager field instead of pinning 10.14.0

Node.js is now set up unconditionally at the start of the job for
the cherry-pick step's pnpm install, so the conditional setup for
the opencode path is redundant.
@TooTallNate
Copy link
Copy Markdown
Member Author

@karthikscale3 thanks for the thorough review! Addressed the two non-blocking suggestions:

  1. Duplicate Setup Node.js: Removed the redundant conditional Setup Node.js (with lts/*) before the opencode step in 149ed34. Node.js 22.x is now set up unconditionally at the top of the job.

  2. Pinned pnpm version: Kept 10.14.0 for consistency — every other workflow in the repo (release.yml, tests.yml, docs-checks.yml, lint.yml, debug-windows.yml) pins this exact version. Unifying the whole repo to read from package.json#packageManager would be a good separate cleanup but out of scope here.

#1771 landed first, so the merge ordering concern is resolved as well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants