Skip to content

Move auth error messages into @workflow/errors package#638

Merged
VaguelySerious merged 4 commits into
mainfrom
peter/fix-stream-resume
Dec 17, 2025
Merged

Move auth error messages into @workflow/errors package#638
VaguelySerious merged 4 commits into
mainfrom
peter/fix-stream-resume

Conversation

@VaguelySerious
Copy link
Copy Markdown
Member

No description provided.

@changeset-bot
Copy link
Copy Markdown

changeset-bot Bot commented Dec 17, 2025

🦋 Changeset detected

Latest commit: 1a6d300

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
Name Type
@workflow/web-shared Patch
@workflow/errors Patch
@workflow/cli Patch
@workflow/builders Patch
@workflow/core Patch
workflow Patch
@workflow/world-local Patch
@workflow/world-postgres Patch
@workflow/world-vercel Patch
@workflow/world-testing Patch
@workflow/astro Patch
@workflow/next Patch
@workflow/nitro Patch
@workflow/sveltekit Patch
@workflow/ai Patch
@workflow/nuxt Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel
Copy link
Copy Markdown
Contributor

vercel Bot commented Dec 17, 2025

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Review Updated (UTC)
example-nextjs-workflow-turbopack Ready Ready Preview, Comment Dec 17, 2025 3:24pm
example-nextjs-workflow-webpack Ready Ready Preview, Comment Dec 17, 2025 3:24pm
example-workflow Ready Ready Preview, Comment Dec 17, 2025 3:24pm
workbench-astro-workflow Ready Ready Preview, Comment Dec 17, 2025 3:24pm
workbench-express-workflow Ready Ready Preview, Comment Dec 17, 2025 3:24pm
workbench-fastify-workflow Ready Ready Preview, Comment Dec 17, 2025 3:24pm
workbench-hono-workflow Ready Ready Preview, Comment Dec 17, 2025 3:24pm
workbench-nitro-workflow Ready Ready Preview, Comment Dec 17, 2025 3:24pm
workbench-nuxt-workflow Ready Ready Preview, Comment Dec 17, 2025 3:24pm
workbench-sveltekit-workflow Ready Ready Preview, Comment Dec 17, 2025 3:24pm
workbench-vite-workflow Ready Ready Preview, Comment Dec 17, 2025 3:24pm
workflow-docs Ready Ready Preview, Comment Dec 17, 2025 3:24pm

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Dec 17, 2025

🧪 E2E Test Results

Some tests failed

Summary

Passed Failed Skipped Total
❌ ▲ Vercel Production 278 8 11 297
✅ 💻 Local Development 262 0 8 270
✅ 📦 Local Production 262 0 8 270
✅ 🐘 Local Postgres 262 0 8 270
✅ 🪟 Windows 27 0 0 27
❌ 🌍 Community Worlds 109 11 0 120
Total 1200 19 35 1254

❌ Failed Tests

▲ Vercel Production (8 failed)

nextjs-turbopack (8 failed):

  • addTenWorkflow
  • addTenWorkflow
  • retryAttemptCounterWorkflow
  • crossFileErrorWorkflow - stack traces work across imported modules
  • hookCleanupTestWorkflow - hook token reuse after workflow completion
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars)
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step
🌍 Community Worlds (11 failed)

mongodb (1 failed):

  • webhookWorkflow

redis (1 failed):

  • webhookWorkflow

starter (8 failed):

  • addTenWorkflow
  • addTenWorkflow
  • retryAttemptCounterWorkflow
  • crossFileErrorWorkflow - stack traces work across imported modules
  • hookCleanupTestWorkflow - hook token reuse after workflow completion
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars)
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step

turso (1 failed):

  • webhookWorkflow

Details by Category

❌ ▲ Vercel Production
App Passed Failed Skipped
✅ astro 26 0 1
✅ example 26 0 1
✅ express 26 0 1
✅ fastify 26 0 1
✅ hono 26 0 1
❌ nextjs-turbopack 18 8 1
✅ nextjs-webpack 26 0 1
✅ nitro 26 0 1
✅ nuxt 26 0 1
✅ sveltekit 26 0 1
✅ vite 26 0 1
✅ 💻 Local Development
App Passed Failed Skipped
✅ astro-stable 26 0 1
✅ express-stable 26 0 1
✅ fastify-stable 26 0 1
✅ hono-stable 26 0 1
✅ nextjs-turbopack-stable 27 0 0
✅ nextjs-webpack-stable 27 0 0
✅ nitro-stable 26 0 1
✅ nuxt-stable 26 0 1
✅ sveltekit-stable 26 0 1
✅ vite-stable 26 0 1
✅ 📦 Local Production
App Passed Failed Skipped
✅ astro-stable 26 0 1
✅ express-stable 26 0 1
✅ fastify-stable 26 0 1
✅ hono-stable 26 0 1
✅ nextjs-turbopack-stable 27 0 0
✅ nextjs-webpack-stable 27 0 0
✅ nitro-stable 26 0 1
✅ nuxt-stable 26 0 1
✅ sveltekit-stable 26 0 1
✅ vite-stable 26 0 1
✅ 🐘 Local Postgres
App Passed Failed Skipped
✅ astro-stable 26 0 1
✅ express-stable 26 0 1
✅ fastify-stable 26 0 1
✅ hono-stable 26 0 1
✅ nextjs-turbopack-stable 27 0 0
✅ nextjs-webpack-stable 27 0 0
✅ nitro-stable 26 0 1
✅ nuxt-stable 26 0 1
✅ sveltekit-stable 26 0 1
✅ vite-stable 26 0 1
✅ 🪟 Windows
App Passed Failed Skipped
✅ nextjs-turbopack 27 0 0
❌ 🌍 Community Worlds
App Passed Failed Skipped
✅ mongodb-dev 3 0 0
❌ mongodb 26 1 0
✅ redis-dev 3 0 0
❌ redis 26 1 0
✅ starter-dev 3 0 0
❌ starter 19 8 0
✅ turso-dev 3 0 0
❌ turso 26 1 0

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Dec 17, 2025

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🌐 Starter 🥇 Next.js (Turbopack) 0.037s (-6.8% 🟢) 1.013s (~) 0.976s 10 1.00x
💻 Local Next.js (Turbopack) 0.041s (+2.5%) 1.018s (~) 0.977s 10 1.09x
🌐 Redis Next.js (Turbopack) 0.042s (+0.7%) 1.018s (~) 0.976s 10 1.13x
💻 Local Nitro 0.042s (-0.7%) 1.006s (~) 0.964s 10 1.13x
💻 Local Express 0.046s (+6.9% 🔺) 1.007s (~) 0.961s 10 1.25x
🌐 Turso Next.js (Turbopack) 0.102s (+1.5%) 1.015s (~) 0.913s 10 2.74x
🌐 MongoDB Next.js (Turbopack) 0.116s (+76.3% 🔺) 1.014s (~) 0.897s 10 3.13x
🐘 Postgres Next.js (Turbopack) 0.153s (+34.4% 🔺) 1.021s (~) 0.868s 10 4.12x
🐘 Postgres Nitro 0.200s (-27.9% 🟢) 1.013s (~) 0.814s 10 5.39x
🐘 Postgres Express 0.338s (-12.3% 🟢) 1.014s (~) 0.676s 10 9.11x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 0.539s (~) 1.521s (+4.3%) 0.982s 10 1.00x
▲ Vercel Nitro 0.684s (+12.8% 🔺) 1.580s (+3.3%) 0.896s 10 1.27x
▲ Vercel Next.js (Turbopack) 0.779s (+8.3% 🔺) 1.647s (-0.6%) 0.868s 10 1.44x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🌐 Starter 🥇 Next.js (Turbopack) 1.094s (~) 2.009s (~) 0.915s 10 1.00x
💻 Local Next.js (Turbopack) 1.096s (~) 2.012s (~) 0.916s 10 1.00x
🌐 Redis Next.js (Turbopack) 1.103s (~) 2.012s (~) 0.909s 10 1.01x
💻 Local Nitro 1.110s (~) 2.006s (~) 0.896s 10 1.01x
💻 Local Express 1.117s (~) 2.008s (~) 0.891s 10 1.02x
🌐 Turso Next.js (Turbopack) 1.308s (+1.3%) 2.012s (~) 0.704s 10 1.20x
🌐 MongoDB Next.js (Turbopack) 1.309s (~) 2.012s (~) 0.703s 10 1.20x
🐘 Postgres Next.js (Turbopack) 1.912s (-1.5%) 2.116s (+4.8%) 0.204s 10 1.75x
🐘 Postgres Express 2.182s (-1.8%) 3.016s (~) 0.834s 10 1.99x
🐘 Postgres Nitro 2.259s (+6.5% 🔺) 3.014s (~) 0.756s 10 2.06x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 2.608s (-19.1% 🟢) 3.556s (-14.5% 🟢) 0.948s 10 1.00x
▲ Vercel Express 2.675s (~) 3.569s (-4.5%) 0.894s 10 1.03x
▲ Vercel Next.js (Turbopack) 3.511s (+32.5% 🔺) 4.425s (+17.5% 🔺) 0.914s 10 1.35x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🌐 Starter 🥇 Next.js (Turbopack) 10.587s (~) 11.010s (~) 0.423s 5 1.00x
🌐 Redis Next.js (Turbopack) 10.687s (~) 11.021s (~) 0.333s 5 1.01x
💻 Local Next.js (Turbopack) 10.692s (+0.5%) 11.016s (~) 0.324s 5 1.01x
💻 Local Nitro 10.773s (~) 11.010s (~) 0.238s 5 1.02x
💻 Local Express 10.794s (~) 11.013s (~) 0.218s 5 1.02x
🌐 Turso Next.js (Turbopack) 12.206s (~) 13.028s (~) 0.822s 5 1.15x
🌐 MongoDB Next.js (Turbopack) 12.226s (~) 13.024s (~) 0.799s 5 1.15x
🐘 Postgres Next.js (Turbopack) 15.285s (+2.0%) 16.036s (+2.6%) 0.750s 5 1.44x
🐘 Postgres Express 20.279s (~) 21.032s (~) 0.753s 5 1.92x
🐘 Postgres Nitro 20.407s (~) 21.040s (~) 0.633s 5 1.93x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 21.960s (+3.0%) 22.638s (+2.1%) 0.678s 5 1.00x
▲ Vercel Nitro 22.265s (+6.7% 🔺) 22.920s (+5.7% 🔺) 0.655s 5 1.01x
▲ Vercel Next.js (Turbopack) 23.567s (+13.0% 🔺) 24.675s (+14.3% 🔺) 1.107s 5 1.07x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 10 parallel steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🌐 Starter 🥇 Next.js (Turbopack) 1.343s (-0.8%) 2.008s (~) 0.664s 5 1.00x
🌐 Redis Next.js (Turbopack) 1.345s (~) 2.011s (~) 0.666s 5 1.00x
💻 Local Next.js (Turbopack) 1.393s (+3.3%) 2.014s (~) 0.621s 5 1.04x
💻 Local Express 1.397s (~) 2.007s (~) 0.610s 5 1.04x
💻 Local Nitro 1.405s (+2.3%) 2.007s (~) 0.602s 5 1.05x
🐘 Postgres Next.js (Turbopack) 1.621s (-13.1% 🟢) 2.013s (~) 0.392s 5 1.21x
🌐 MongoDB Next.js (Turbopack) 2.137s (~) 3.018s (~) 0.881s 5 1.59x
🌐 Turso Next.js (Turbopack) 2.152s (~) 3.013s (~) 0.860s 5 1.60x
🐘 Postgres Nitro 2.484s (-4.4%) 3.013s (~) 0.529s 5 1.85x
🐘 Postgres Express 2.696s (+1.9%) 3.017s (~) 0.321s 5 2.01x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 4.150s (+6.2% 🔺) 5.099s (+3.1%) 0.949s 5 1.00x
▲ Vercel Next.js (Turbopack) 4.261s (+13.8% 🔺) 5.018s (+7.9% 🔺) 0.757s 5 1.03x
▲ Vercel Nitro 4.268s (+11.3% 🔺) 5.103s (+10.7% 🔺) 0.835s 5 1.03x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

stress test: Promise.all with 100 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🌐 Starter 🥇 Next.js (Turbopack) 6.533s (~) 6.904s (-1.7%) 0.372s 5 1.00x
🌐 Redis Next.js (Turbopack) 8.008s (+0.8%) 8.283s (+0.8%) 0.275s 4 1.23x
🐘 Postgres Nitro 8.857s (+0.7%) 9.255s (+2.4%) 0.398s 4 1.36x
🐘 Postgres Express 9.332s (+3.6%) 9.547s (+3.1%) 0.215s 4 1.43x
🐘 Postgres Next.js (Turbopack) 9.393s (+7.5% 🔺) 9.947s (+10.5% 🔺) 0.555s 4 1.44x
💻 Local Express 13.560s (+3.1%) 13.636s (+2.9%) 0.076s 3 2.08x
💻 Local Nitro 14.459s (+9.4% 🔺) 14.665s (+10.0% 🔺) 0.205s 3 2.21x
💻 Local Next.js (Turbopack) 15.556s (-1.6%) 15.856s (~) 0.299s 2 2.38x
🌐 Turso Next.js (Turbopack) 19.960s (-1.4%) 20.535s (~) 0.575s 2 3.06x
🌐 MongoDB Next.js (Turbopack) 20.073s (-1.0%) 20.524s (~) 0.451s 2 3.07x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 21.459s (+6.7% 🔺) 22.201s (+5.7% 🔺) 0.742s 2 1.00x
▲ Vercel Nitro 21.564s (+3.2%) 22.513s (+4.7%) 0.949s 2 1.00x
▲ Vercel Next.js (Turbopack) 23.393s (+11.5% 🔺) 24.337s (+12.4% 🔺) 0.944s 2 1.09x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

stress test: Promise.race with 100 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
🌐 Starter 🥇 Next.js (Turbopack) 6.617s (~) 6.917s (~) 0.300s 5 1.00x
🌐 Redis Next.js (Turbopack) 8.424s (~) 8.706s (-2.6%) 0.282s 4 1.27x
🐘 Postgres Express 9.628s (+4.8%) 9.981s (+4.4%) 0.353s 4 1.46x
🐘 Postgres Nitro 9.824s (+2.4%) 10.041s (+1.2%) 0.217s 3 1.48x
🐘 Postgres Next.js (Turbopack) 10.141s (+4.8%) 10.459s (+6.1% 🔺) 0.318s 3 1.53x
💻 Local Express 14.603s (-1.5%) 14.814s (-2.2%) 0.211s 3 2.21x
💻 Local Next.js (Turbopack) 15.589s (-12.0% 🟢) 16.006s (-11.0% 🟢) 0.417s 2 2.36x
💻 Local Nitro 16.204s (+16.5% 🔺) 16.345s (+15.6% 🔺) 0.140s 2 2.45x
🌐 MongoDB Next.js (Turbopack) 19.881s (~) 20.554s (~) 0.673s 2 3.00x
🌐 Turso Next.js (Turbopack) 20.387s (~) 20.533s (-2.8%) 0.147s 2 3.08x

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 21.369s (+4.5%) 22.027s (+4.2%) 0.657s 2 1.00x
▲ Vercel Next.js (Turbopack) 22.746s (+12.9% 🔺) 23.757s (+12.4% 🔺) 1.011s 2 1.06x
▲ Vercel Express 23.791s (+20.0% 🔺) 24.281s (+17.9% 🔺) 0.491s 2 1.11x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Stream Benchmarks (includes TTFB metrics)
workflow with stream

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
🌐 Starter 🥇 Next.js (Turbopack) 0.127s (~) 1.004s (~) 0.000s (NaN%) 1.009s (~) 0.883s 10 1.00x
💻 Local Next.js (Turbopack) 0.144s (+7.7% 🔺) 1.003s (~) 0.016s (+2.5%) 1.029s (~) 0.884s 10 1.14x
🌐 Redis Next.js (Turbopack) 0.145s (+1.3%) 1.005s (~) 0.000s (+Infinity% 🔺) 1.014s (~) 0.869s 10 1.15x
💻 Local Nitro 0.173s (~) 0.992s (~) 0.014s (+5.9% 🔺) 1.020s (~) 0.846s 10 1.37x
💻 Local Express 0.176s (~) 0.992s (~) 0.014s (-1.4%) 1.020s (~) 0.844s 10 1.39x
🌐 MongoDB Next.js (Turbopack) 0.457s (-10.6% 🟢) 0.990s (+5.3% 🔺) 0.000s (NaN%) 1.012s (~) 0.556s 10 3.61x
🌐 Turso Next.js (Turbopack) 0.461s (-15.1% 🟢) 0.993s (+7.1% 🔺) 0.000s (+Infinity% 🔺) 1.013s (~) 0.553s 10 3.64x
🐘 Postgres Next.js (Turbopack) 1.169s (+19.1% 🔺) 1.547s (+22.0% 🔺) 0.000s (NaN%) 1.720s (+30.7% 🔺) 0.551s 10 9.24x
🐘 Postgres Nitro 2.132s (-5.6% 🟢) 2.913s (+4.5%) 0.000s (-100.0% 🟢) 3.015s (~) 0.883s 10 16.84x
🐘 Postgres Express 2.306s (+0.8%) 2.737s (-0.7%) 0.000s (+Infinity% 🔺) 3.016s (~) 0.709s 10 18.22x

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.823s (+8.6% 🔺) 3.156s (+2.5%) 0.372s (+64.8% 🔺) 3.988s (+7.5% 🔺) 1.164s 10 1.00x
▲ Vercel Nitro 2.936s (+16.5% 🔺) 3.269s (+6.2% 🔺) 0.324s (+8.6% 🔺) 4.077s (+8.8% 🔺) 1.141s 10 1.04x
▲ Vercel Next.js (Turbopack) 3.235s (+26.4% 🔺) 4.586s (+49.1% 🔺) 1.590s (+187.6% 🔺) 6.702s (+66.4% 🔺) 3.468s 10 1.15x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World 🥇 Fastest Framework Wins
💻 Local Next.js (Turbopack) 5/7
🐘 Postgres Next.js (Turbopack) 5/7
▲ Vercel Express 5/7
Fastest World by Framework

Winner determined by most benchmark wins

Framework 🥇 Fastest World Wins
Express 💻 Local 5/7
Next.js (Turbopack) 🌐 Starter 7/7
Nitro 💻 Local 5/7
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Starter: Community world (local development)
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run

@VaguelySerious VaguelySerious merged commit 4bdd3e5 into main Dec 17, 2025
87 of 89 checks passed
@VaguelySerious VaguelySerious deleted the peter/fix-stream-resume branch December 17, 2025 15:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant