Skip to content

fix(workflow): improve runtime API stub error message and fix SKILL.md streaming docs#1077

Merged
pranaygp merged 9 commits into
mainfrom
fix/improve-workflow-api-stub-error-and-skill-streaming
Feb 19, 2026
Merged

fix(workflow): improve runtime API stub error message and fix SKILL.md streaming docs#1077
pranaygp merged 9 commits into
mainfrom
fix/improve-workflow-api-stub-error-and-skill-streaming

Conversation

@pranaygp
Copy link
Copy Markdown
Contributor

@pranaygp pranaygp commented Feb 16, 2026

Summary

  • Improve the error message when start(), getRun(), resumeHook(), etc. are called inside a workflow function — now tells users to move the call to a step function or outside the workflow context
  • Fix the SKILL.md streaming section which incorrectly stated getWritable() only works in steps — it can be called in both workflow and step contexts, but stream operations (write/close) must happen in steps
  • Fix the SKILL.md debugging section: remove non-existent --app-url flag, add npx workflow web <run_id> usage, reorganize examples, and add --json/--help tips

Test plan

  • Verify the updated error message appears when calling start() inside a "use workflow" function
  • Verify SKILL.md accurately reflects the getWritable() behavior documented in get-writable.mdx
  • Verify SKILL.md debugging commands match actual CLI --help output

🤖 Generated with Claude Code

pranaygp and others added 2 commits February 15, 2026 21:20
…w context and fix SKILL.md streaming docs

The workflow stub error now tells users to move calls to a step function or outside the workflow context. Also corrects the SKILL.md streaming section which incorrectly stated getWritable() only works in steps.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@changeset-bot
Copy link
Copy Markdown

changeset-bot Bot commented Feb 16, 2026

🦋 Changeset detected

Latest commit: e50a10f

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 14 packages
Name Type
workflow Patch
@workflow/world-testing Patch
@workflow/core Patch
@workflow/builders Patch
@workflow/cli Patch
@workflow/next Patch
@workflow/nitro Patch
@workflow/web-shared Patch
@workflow/astro Patch
@workflow/nest Patch
@workflow/rollup Patch
@workflow/sveltekit Patch
@workflow/vite Patch
@workflow/nuxt Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel
Copy link
Copy Markdown
Contributor

vercel Bot commented Feb 16, 2026

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Feb 16, 2026

🧪 E2E Test Results

Some tests failed

Summary

Passed Failed Skipped Total
❌ ▲ Vercel Production 533 1 38 572
✅ 💻 Local Development 556 0 68 624
✅ 📦 Local Production 556 0 68 624
✅ 🐘 Local Postgres 556 0 68 624
✅ 🪟 Windows 49 0 3 52
❌ 🌍 Community Worlds 111 45 9 165
✅ 📋 Other 135 0 21 156
Total 2496 46 275 2817

❌ Failed Tests

▲ Vercel Production (1 failed)

sveltekit (1 failed):

  • error handling retry behavior workflow completes despite transient 5xx on step_completed
🌍 Community Worlds (45 failed)

turso (45 failed):

  • addTenWorkflow
  • addTenWorkflow
  • should work with react rendering in step
  • promiseAllWorkflow
  • promiseRaceWorkflow
  • promiseAnyWorkflow
  • hookWorkflow
  • webhookWorkflow
  • sleepingWorkflow
  • parallelSleepWorkflow
  • nullByteWorkflow
  • workflowAndStepMetadataWorkflow
  • fetchWorkflow
  • promiseRaceStressTestWorkflow
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling retry behavior RetryableError respects custom retryAfter delay
  • error handling retry behavior maxRetries=0 disables retries
  • error handling retry behavior workflow completes despite transient 5xx on step_completed
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • hookCleanupTestWorkflow - hook token reuse after workflow completion
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars)
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument
  • closureVariableWorkflow - nested step functions with closure variables
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly
  • Calculator.calculate - static workflow method using static step methods from another class
  • AllInOneService.processNumber - static workflow method using sibling static step methods
  • ChainableService.processWithThis - static step methods using this to reference the class
  • thisSerializationWorkflow - step function invoked with .call() and .apply()
  • customSerializationWorkflow - custom class serialization with WORKFLOW_SERIALIZE/WORKFLOW_DESERIALIZE
  • instanceMethodStepWorkflow - instance methods with "use step" directive
  • crossContextSerdeWorkflow - classes defined in step code are deserializable in workflow context
  • stepFunctionAsStartArgWorkflow - step function reference passed as start() argument
  • cancelRun - cancelling a running workflow
  • cancelRun via CLI - cancelling a running workflow
  • pages router addTenWorkflow via pages router
  • pages router promiseAllWorkflow via pages router
  • pages router sleepingWorkflow via pages router

Details by Category

❌ ▲ Vercel Production
App Passed Failed Skipped
✅ astro 48 0 4
✅ example 48 0 4
✅ express 48 0 4
✅ fastify 48 0 4
✅ hono 48 0 4
✅ nextjs-turbopack 51 0 1
✅ nextjs-webpack 51 0 1
✅ nitro 48 0 4
✅ nuxt 48 0 4
❌ sveltekit 47 1 4
✅ vite 48 0 4
✅ 💻 Local Development
App Passed Failed Skipped
✅ astro-stable 45 0 7
✅ express-stable 45 0 7
✅ fastify-stable 45 0 7
✅ hono-stable 45 0 7
✅ nextjs-turbopack-canary 49 0 3
✅ nextjs-turbopack-stable 49 0 3
✅ nextjs-webpack-canary 49 0 3
✅ nextjs-webpack-stable 49 0 3
✅ nitro-stable 45 0 7
✅ nuxt-stable 45 0 7
✅ sveltekit-stable 45 0 7
✅ vite-stable 45 0 7
✅ 📦 Local Production
App Passed Failed Skipped
✅ astro-stable 45 0 7
✅ express-stable 45 0 7
✅ fastify-stable 45 0 7
✅ hono-stable 45 0 7
✅ nextjs-turbopack-canary 49 0 3
✅ nextjs-turbopack-stable 49 0 3
✅ nextjs-webpack-canary 49 0 3
✅ nextjs-webpack-stable 49 0 3
✅ nitro-stable 45 0 7
✅ nuxt-stable 45 0 7
✅ sveltekit-stable 45 0 7
✅ vite-stable 45 0 7
✅ 🐘 Local Postgres
App Passed Failed Skipped
✅ astro-stable 45 0 7
✅ express-stable 45 0 7
✅ fastify-stable 45 0 7
✅ hono-stable 45 0 7
✅ nextjs-turbopack-canary 49 0 3
✅ nextjs-turbopack-stable 49 0 3
✅ nextjs-webpack-canary 49 0 3
✅ nextjs-webpack-stable 49 0 3
✅ nitro-stable 45 0 7
✅ nuxt-stable 45 0 7
✅ sveltekit-stable 45 0 7
✅ vite-stable 45 0 7
✅ 🪟 Windows
App Passed Failed Skipped
✅ nextjs-turbopack 49 0 3
❌ 🌍 Community Worlds
App Passed Failed Skipped
✅ mongodb-dev 3 0 0
✅ mongodb 49 0 3
✅ redis-dev 3 0 0
✅ redis 49 0 3
✅ turso-dev 3 0 0
❌ turso 4 45 3
✅ 📋 Other
App Passed Failed Skipped
✅ e2e-local-dev-nest-stable 45 0 7
✅ e2e-local-postgres-nest-stable 45 0 7
✅ e2e-local-prod-nest-stable 45 0 7

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Feb 16, 2026

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 0.032s (-7.0% 🟢) 1.005s (~) 0.973s 10 1.00x
💻 Local Express 0.032s (~) 1.004s (~) 0.972s 10 1.01x
🐘 Postgres Express 0.177s (-59.7% 🟢) 1.010s (~) 0.833s 10 5.55x
🐘 Postgres Nitro 0.259s (-48.3% 🟢) 1.009s (~) 0.750s 10 8.15x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 0.541s (-79.6% 🟢) 1.851s (-51.4% 🟢) 1.309s 10 1.00x
▲ Vercel Nitro 0.619s (-38.6% 🟢) 1.908s (-22.1% 🟢) 1.289s 10 1.14x
▲ Vercel Next.js (Turbopack) 0.654s (-77.5% 🟢) 2.047s (-49.1% 🟢) 1.393s 10 1.21x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 1.106s (~) 2.006s (~) 0.900s 10 1.00x
💻 Local Express 1.107s (~) 2.005s (~) 0.898s 10 1.00x
🐘 Postgres Nitro 2.445s (+5.0% 🔺) 3.014s (+3.4%) 0.569s 10 2.21x
🐘 Postgres Express 2.447s (+6.2% 🔺) 3.013s (~) 0.566s 10 2.21x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.229s (-4.8%) 2.857s (-6.4% 🟢) 0.628s 10 1.00x
▲ Vercel Nitro 2.293s (-3.2%) 3.239s (-0.6%) 0.946s 10 1.03x
▲ Vercel Next.js (Turbopack) 2.338s (+1.4%) 3.270s (+7.4% 🔺) 0.932s 10 1.05x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 10.823s (~) 11.020s (~) 0.197s 3 1.00x
💻 Local Nitro 10.830s (~) 11.021s (~) 0.191s 3 1.00x
🐘 Postgres Express 20.305s (+0.7%) 21.053s (~) 0.748s 2 1.88x
🐘 Postgres Nitro 20.315s (+33.2% 🔺) 21.056s (+31.2% 🔺) 0.741s 2 1.88x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 21.227s (+16.6% 🔺) 22.108s (+15.2% 🔺) 0.880s 2 1.00x
▲ Vercel Nitro 23.983s (+24.5% 🔺) 25.872s (+26.4% 🔺) 1.889s 2 1.13x
▲ Vercel Next.js (Turbopack) 28.987s (+59.4% 🔺) 30.076s (+53.2% 🔺) 1.089s 1 1.37x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 27.446s (~) 28.049s (~) 0.603s 3 1.00x
💻 Local Nitro 27.447s (-0.6%) 28.050s (~) 0.602s 3 1.00x
🐘 Postgres Express 50.336s (~) 51.120s (~) 0.784s 2 1.83x
🐘 Postgres Nitro 50.360s (+33.2% 🔺) 51.122s (+34.2% 🔺) 0.762s 2 1.83x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 44.633s (-6.6% 🟢) 45.610s (-6.9% 🟢) 0.978s 2 1.00x
▲ Vercel Express 45.168s (+0.7%) 46.140s (+0.7%) 0.972s 2 1.01x
▲ Vercel Next.js (Turbopack) 45.822s (+3.0%) 47.188s (+3.1%) 1.366s 2 1.03x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 57.065s (-0.6%) 57.099s (-1.7%) 0.034s 2 1.00x
💻 Local Express 57.117s (~) 58.101s (~) 0.984s 2 1.00x
🐘 Postgres Express 100.262s (~) 101.209s (~) 0.947s 1 1.76x
🐘 Postgres Nitro 100.298s (+32.0% 🔺) 101.221s (+32.9% 🔺) 0.923s 1 1.76x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 90.866s (~) 91.861s (~) 0.995s 1 1.00x
▲ Vercel Nitro 91.268s (-4.6%) 92.346s (-5.0% 🟢) 1.078s 1 1.00x
▲ Vercel Next.js (Turbopack) 91.555s (-1.0%) 93.204s (~) 1.649s 1 1.01x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 1.398s (-0.7%) 2.004s (~) 0.606s 15 1.00x
💻 Local Express 1.424s (~) 2.005s (~) 0.580s 15 1.02x
🐘 Postgres Express 2.348s (-4.5%) 3.013s (~) 0.665s 10 1.68x
🐘 Postgres Nitro 2.442s (+5.9% 🔺) 3.013s (~) 0.571s 10 1.75x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 2.496s (-3.2%) 3.417s (-2.8%) 0.921s 9 1.00x
▲ Vercel Express 2.515s (+8.7% 🔺) 3.214s (+2.8%) 0.699s 10 1.01x
▲ Vercel Next.js (Turbopack) 4.053s (+73.1% 🔺) 5.079s (+66.2% 🔺) 1.026s 6 1.62x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 2.547s (~) 3.007s (~) 0.460s 10 1.00x
💻 Local Nitro 2.568s (+1.1%) 3.007s (~) 0.439s 10 1.01x
🐘 Postgres Express 8.871s (+12.2% 🔺) 9.280s (+8.8% 🔺) 0.409s 4 3.48x
🐘 Postgres Nitro 8.936s (+7.6% 🔺) 9.279s (+2.7%) 0.343s 4 3.51x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.755s (+1.8%) 3.570s (+3.0%) 0.815s 9 1.00x
▲ Vercel Next.js (Turbopack) 2.831s (+5.4% 🔺) 3.669s (+10.3% 🔺) 0.838s 9 1.03x
▲ Vercel Nitro 3.091s (+13.4% 🔺) 4.129s (+10.0% 🔺) 1.038s 8 1.12x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

Promise.all with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 7.266s (+0.6%) 8.021s (~) 0.755s 4 1.00x
💻 Local Nitro 7.453s (+2.1%) 8.019s (~) 0.566s 4 1.03x
🐘 Postgres Nitro 50.922s (~) 51.130s (~) 0.208s 1 7.01x
🐘 Postgres Express 51.891s (+32.6% 🔺) 52.140s (+30.0% 🔺) 0.249s 1 7.14x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 3.100s (-9.9% 🟢) 4.213s (-10.4% 🟢) 1.113s 8 1.00x
▲ Vercel Nitro 5.555s (+30.6% 🔺) 6.979s (+32.2% 🔺) 1.424s 5 1.79x
▲ Vercel Next.js (Turbopack) 5.972s (+94.0% 🔺) 7.273s (+82.1% 🔺) 1.301s 6 1.93x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 1.431s (-1.2%) 2.005s (~) 0.574s 15 1.00x
💻 Local Express 1.444s (+2.3%) 2.004s (~) 0.560s 15 1.01x
🐘 Postgres Nitro 2.056s (-10.8% 🟢) 2.922s (+6.6% 🔺) 0.866s 11 1.44x
🐘 Postgres Express 2.265s (+4.2%) 3.013s (+16.1% 🔺) 0.748s 10 1.58x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 2.897s (-18.0% 🟢) 3.815s (-13.7% 🟢) 0.918s 8 1.00x
▲ Vercel Next.js (Turbopack) 3.083s (+17.1% 🔺) 4.004s (+19.5% 🔺) 0.921s 8 1.06x
▲ Vercel Express 9.347s (+205.6% 🔺) 10.133s (+160.5% 🔺) 0.786s 3 3.23x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Promise.race with 25 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 2.692s (+1.3%) 3.007s (~) 0.315s 10 1.00x
💻 Local Nitro 2.733s (+2.6%) 3.008s (~) 0.276s 10 1.01x
🐘 Postgres Express 9.613s (-16.1% 🟢) 10.027s (-16.7% 🟢) 0.414s 4 3.57x
🐘 Postgres Nitro 10.520s (-11.4% 🟢) 11.365s (-8.1% 🟢) 0.845s 3 3.91x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 2.470s (-34.9% 🟢) 3.268s (-29.0% 🟢) 0.798s 10 1.00x
▲ Vercel Nitro 2.576s (-0.7%) 3.460s (+2.5%) 0.884s 9 1.04x
▲ Vercel Next.js (Turbopack) 3.619s (+5.6% 🔺) 4.670s (+16.3% 🔺) 1.051s 7 1.47x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Express 7.646s (-4.2%) 8.018s (-5.9% 🟢) 0.372s 4 1.00x
💻 Local Nitro 7.942s (+2.0%) 8.269s (+3.1%) 0.327s 4 1.04x
🐘 Postgres Nitro 48.203s (-4.6%) 49.109s (-3.9%) 0.906s 1 6.30x
🐘 Postgres Express 50.615s (-3.5%) 51.106s (-3.8%) 0.491s 1 6.62x
💻 Local Next.js (Turbopack) ⚠️ missing - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - -

▲ Production (Vercel)

World Framework Workflow Time Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Nitro 3.108s (-21.6% 🟢) 4.459s (-16.4% 🟢) 1.350s 7 1.00x
▲ Vercel Express 3.228s (-16.5% 🟢) 4.261s (-11.6% 🟢) 1.033s 8 1.04x
▲ Vercel Next.js (Turbopack) 3.749s (+9.3% 🔺) 5.126s (+19.1% 🔺) 1.377s 6 1.21x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks (includes TTFB metrics)
workflow with stream

💻 Local Development

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
💻 Local 🥇 Nitro 0.170s (-7.4% 🟢) 1.002s (~) 0.010s (~) 1.016s (~) 0.845s 10 1.00x
💻 Local Express 0.174s (+1.5%) 1.002s (~) 0.010s (-7.2% 🟢) 1.015s (~) 0.841s 10 1.02x
🐘 Postgres Express 2.404s (+11.9% 🔺) 2.638s (-8.9% 🟢) 0.001s (-6.7% 🟢) 3.014s (~) 0.610s 10 14.12x
🐘 Postgres Nitro 2.434s (+86.2% 🔺) 2.608s (+50.4% 🔺) 0.001s (~) 3.014s (+49.7% 🔺) 0.580s 10 14.29x
💻 Local Next.js (Turbopack) ⚠️ missing - - - - -
🐘 Postgres Next.js (Turbopack) ⚠️ missing - - - - -

▲ Production (Vercel)

World Framework Workflow Time TTFB Slurp Wall Time Overhead Samples vs Fastest
▲ Vercel 🥇 Express 1.897s (-6.8% 🟢) 2.359s (-6.6% 🟢) 0.186s (-1.5%) 2.999s (-8.5% 🟢) 1.101s 10 1.00x
▲ Vercel Next.js (Turbopack) 2.167s (+8.3% 🔺) 2.784s (+17.0% 🔺) 0.496s (-22.0% 🟢) 3.947s (+12.9% 🔺) 1.780s 10 1.14x
▲ Vercel Nitro 2.184s (+6.7% 🔺) 2.827s (+8.0% 🔺) 0.279s (+43.8% 🔺) 3.645s (+4.8%) 1.460s 10 1.15x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World 🥇 Fastest Framework Wins
💻 Local Nitro 6/12
🐘 Postgres Express 8/12
▲ Vercel Express 8/12
Fastest World by Framework

Winner determined by most benchmark wins

Framework 🥇 Fastest World Wins
Express 💻 Local 9/12
Next.js (Turbopack) ▲ Vercel 12/12
Nitro 💻 Local 9/12
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run

Comment thread skills/workflow/SKILL.md Outdated
Comment thread skills/workflow/SKILL.md Outdated
Comment thread skills/workflow/SKILL.md
- Remove `npx workflow start` from debugging section (args can't easily be passed via CLI)
- Mention --json and --help flags for CLI inspection
- Add reminder to check AI docs for DurableAgent details

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Copy link
Copy Markdown
Contributor

@johnlindquist johnlindquist left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

skill looks solid

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants