Conversation
🧪 E2E Test Results❌ Some tests failed Summary
❌ Failed Tests🌍 Community Worlds (56 failed)mongodb (3 failed):
redis (2 failed):
turso (51 failed):
Details by Category✅ ▲ Vercel Production
✅ 💻 Local Development
✅ 📦 Local Production
✅ 🐘 Local Postgres
✅ 🪟 Windows
❌ 🌍 Community Worlds
✅ 📋 Other
|
📊 Benchmark Results
workflow with no steps💻 Local Development
▲ Production (Vercel)
🔍 Observability: Express | Next.js (Turbopack) | Nitro workflow with 1 step💻 Local Development
▲ Production (Vercel)
🔍 Observability: Express | Nitro | Next.js (Turbopack) workflow with 10 sequential steps💻 Local Development
▲ Production (Vercel)
🔍 Observability: Nitro | Next.js (Turbopack) | Express workflow with 25 sequential steps💻 Local Development
▲ Production (Vercel)
🔍 Observability: Express | Nitro | Next.js (Turbopack) workflow with 50 sequential steps💻 Local Development
▲ Production (Vercel)
🔍 Observability: Next.js (Turbopack) | Nitro | Express Promise.all with 10 concurrent steps💻 Local Development
▲ Production (Vercel)
🔍 Observability: Nitro | Express | Next.js (Turbopack) Promise.all with 25 concurrent steps💻 Local Development
▲ Production (Vercel)
🔍 Observability: Express | Nitro | Next.js (Turbopack) Promise.all with 50 concurrent steps💻 Local Development
▲ Production (Vercel)
🔍 Observability: Express | Nitro | Next.js (Turbopack) Promise.race with 10 concurrent steps💻 Local Development
▲ Production (Vercel)
🔍 Observability: Nitro | Express | Next.js (Turbopack) Promise.race with 25 concurrent steps💻 Local Development
▲ Production (Vercel)
🔍 Observability: Express | Next.js (Turbopack) | Nitro Promise.race with 50 concurrent steps💻 Local Development
▲ Production (Vercel)
🔍 Observability: Express | Nitro | Next.js (Turbopack) Stream Benchmarks (includes TTFB metrics)workflow with stream💻 Local Development
▲ Production (Vercel)
🔍 Observability: Nitro | Express | Next.js (Turbopack) SummaryFastest Framework by WorldWinner determined by most benchmark wins
Fastest World by FrameworkWinner determined by most benchmark wins
Column Definitions
Worlds:
|
594aee1 to
34f512a
Compare
35f77fd to
fc336b1
Compare
fc336b1 to
fdc45b8
Compare
This PR was opened by the Changesets release GitHub action. When you're ready to do a release, you can merge this and the packages will be published to npm automatically. If you're not ready to do a release yet, that's fine, whenever you add more changesets to main, this PR will be updated.
mainis currently in pre mode so this branch has prereleases rather than normal releases. If you want to exit prereleases, runchangeset pre exitonmain.Releases
@workflow/ai@4.1.0-beta.57
Minor Changes
74aea7bThanks @pranaygp! - BREAKING CHANGE: Migrate to AI SDK v6. Drop AI SDK v5 support.LanguageModelV2*→LanguageModelV3*)ai^5 || ^6→^6,@ai-sdk/provider^2 || ^3→^3CompatibleLanguageModelfrom V2|V3 union toLanguageModelV3providerExecutedguard on tool-result stream parts (V3: all tool-results are provider-executed)instructionsconstructor option (replaces deprecatedsystem)onStepFinishandonFinishon constructor (merged with stream callbacks)timeoutstream optiononFinishevent withtext,finishReason,totalUsage@workflow/ai/testexport withmockTextModelandmockSequenceModelfor workflow e2e testingOutputSpecificationto match AI SDK v6 Output interfaceWorkflowChatTransportto forwardbodyandheadersfromChatRequestOptionstoprepareSendMessagesRequestand the default request bodyPatch Changes
#1385
2c80ec7Thanks @VaguelySerious! - Add type helpers (InferDurableAgentTools,InferDurableAgentUIMessage), supportprepareSteponDurableAgentconstructor, fixsupportedUrlscausingAI_DownloadErrorfor image URLs, and add telemetry span support forexperimental_telemetry. FixLanguageModelV3ToolResultOutputbreaking response when not json compatible.#1389
4a298b5Thanks @TooTallNate! - FixprepareStepsystem message being discarded whenmessagesis also returnedUpdated dependencies [
dcb0761]:@workflow/astro@4.0.0-beta.45
Patch Changes
5d95abf,3cc2943]:@workflow/builders@4.0.1-beta.62
Patch Changes
#1420
3cc2943Thanks @TooTallNate! - SetmaxDurationin generated.vc-config.jsonfor workflow functions ("max"for step,60for flow)Updated dependencies [
97e4384,5d95abf,dcb0761,2f0772d,a2c0c7e,2cc42cb,f52afe7]:@workflow/cli@4.2.0-beta.71
Patch Changes
02ea057,97e4384,d6e8727,5d95abf,dcb0761,3cc2943,2f0772d,7b9b3c1,a2c0c7e,0f07403,2cc42cb,e902980,94c14c7,f52afe7]:@workflow/core@4.2.0-beta.71
Patch Changes
#1409
97e4384Thanks @TooTallNate! - Remove@deprecatedtag fromdeploymentIdinStartOptions#1413
dcb0761Thanks @TooTallNate! - Refactor builtin step functions to usethisvalue serialization instead of explicit parameter passing. Remove unused duplicate builtins file from@workflow/core.#1396
2f0772dThanks @karthikscale3! - Track Vercel request IDs (x-vercel-id) on all workflow events for correlating request logs with workflow executions#1400
a2c0c7eThanks @VaguelySerious! - Seed lazy workflow file discovery in NextJS. Require workflow definitions to be in manifest for Vercel environments.#1418
2cc42cbThanks @VaguelySerious! - Don't fail to queue on 409 responses#1402
f52afe7Thanks @VaguelySerious! - Reduce log severity for 409/429 logs fromwarntoinfo, as they can't be meaningfully acted on by the consumer.Updated dependencies [
02ea057,d6e8727,2f0772d,0f07403,e902980,94c14c7]:@workflow/nest@0.0.0-beta.20
Patch Changes
5d95abf,3cc2943]:@workflow/next@4.0.1-beta.67
Patch Changes
#1420
3cc2943Thanks @TooTallNate! - SetmaxDurationin generated.vc-config.jsonfor workflow functions ("max"for step,60for flow)#1400
a2c0c7eThanks @VaguelySerious! - Seed lazy workflow file discovery in NextJS. Require workflow definitions to be in manifest for Vercel environments.Updated dependencies [
97e4384,5d95abf,dcb0761,3cc2943,2f0772d,a2c0c7e,2cc42cb,f52afe7]:@workflow/nitro@4.0.1-beta.66
Patch Changes
97e4384,5d95abf,dcb0761,3cc2943,2f0772d,a2c0c7e,2cc42cb,f52afe7]:@workflow/nuxt@4.0.1-beta.55
Patch Changes
@workflow/rollup@4.0.0-beta.28
Patch Changes
5d95abf,3cc2943]:@workflow/sveltekit@4.0.0-beta.60
Patch Changes
#1420
3cc2943Thanks @TooTallNate! - SetmaxDurationin generated.vc-config.jsonfor workflow functions ("max"for step,60for flow)Updated dependencies [
5d95abf,3cc2943]:@workflow/swc-plugin@4.1.0-beta.20
Patch Changes
5d95abfThanks @TooTallNate! - Fix closure variable detection fornewexpressions, exclude module-level declarations from being over-captured, preserve original step function bodies in enclosing functions for direct calls, and walk into nested function/method bodies to detect deeply nested closure variable usage@workflow/vite@4.0.0-beta.21
Patch Changes
3cc2943]:@workflow/vitest@4.0.1-beta.8
Patch Changes
#1359
0f07403Thanks @VaguelySerious! - Write workflow data for vitest to the same folder as other local world runs, allowing them to be visible in observability tooling. Use a suffix-based system to ensure clearing runs on test start only affects vitest-related data.Updated dependencies [
02ea057,97e4384,dcb0761,3cc2943,2f0772d,a2c0c7e,0f07403,2cc42cb,94c14c7,f52afe7]:@workflow/web@4.1.0-beta.43
Patch Changes
#1381
7b9b3c1Thanks @karthikscale3! - web-shared: Timestamp tooltips, toast adapter, improved skeletons, and encrypted data detection for lazy-loaded eventsweb: Add toast for decryption
#1364
94c14c7Thanks @karthikscale3! - Strip only ref/payload fields from eventData when resolveData is 'none', preserving all other metadata@workflow/web-shared@4.1.0-beta.66
Patch Changes
#1404
0e2eb5cThanks @karthikscale3! - Fix trace viewer construction of traces for v1 runs#1406
29eb8bbThanks @karthikscale3! - Fix trace construction for v1 runs#1381
7b9b3c1Thanks @karthikscale3! - web-shared: Timestamp tooltips, toast adapter, improved skeletons, and encrypted data detection for lazy-loaded eventsweb: Add toast for decryption
#1427
11f45b2Thanks @karthikscale3! - Fix re-rendering of side panel inputs during live poll, sanitize error messages and add loading state for side panel.Updated dependencies [
97e4384,dcb0761,2f0772d,a2c0c7e,2cc42cb,94c14c7,f52afe7]:workflow@4.2.0-beta.71
Patch Changes
#1413
dcb0761Thanks @TooTallNate! - Refactor builtin step functions to usethisvalue serialization instead of explicit parameter passing. Remove unused duplicate builtins file from@workflow/core.Updated dependencies [
97e4384,dcb0761,3cc2943,2f0772d,a2c0c7e,2cc42cb,f52afe7]:@workflow/world@4.1.0-beta.13
Patch Changes
#1396
2f0772dThanks @karthikscale3! - Track Vercel request IDs (x-vercel-id) on all workflow events for correlating request logs with workflow executions#1364
94c14c7Thanks @karthikscale3! - Strip only ref/payload fields from eventData when resolveData is 'none', preserving all other metadata@workflow/world-local@4.1.0-beta.44
Patch Changes
#1417
02ea057Thanks @NathanColosimo! - Remove the unused world-local queue executor API and clean up postgres queue tests.#1359
0f07403Thanks @VaguelySerious! - Write workflow data for vitest to the same folder as other local world runs, allowing them to be visible in observability tooling. Use a suffix-based system to ensure clearing runs on test start only affects vitest-related data.#1364
94c14c7Thanks @karthikscale3! - Strip only ref/payload fields from eventData when resolveData is 'none', preserving all other metadataUpdated dependencies [
2f0772d,94c14c7]:@workflow/world-postgres@4.1.0-beta.46
Patch Changes
#1417
02ea057Thanks @NathanColosimo! - Remove the unused world-local queue executor API and clean up postgres queue tests.#1417
02ea057Thanks @NathanColosimo! - Fix world-postgres queue execution to use workflow HTTP routes instead of in-process handlers.#1364
94c14c7Thanks @karthikscale3! - Strip only ref/payload fields from eventData when resolveData is 'none', preserving all other metadataUpdated dependencies [
02ea057,2f0772d,0f07403,94c14c7]:@workflow/world-testing@4.1.0-beta.72
Patch Changes
97e4384,dcb0761,2f0772d,a2c0c7e,2cc42cb,94c14c7,f52afe7]:@workflow/world-vercel@4.1.0-beta.44
Patch Changes
#1378
d6e8727Thanks @TooTallNate! - Reorder token resolution infetchRunKeyandresolveLatestDeploymentIdto preferoptions.token/VERCEL_TOKENbefore calling OIDC, skipping the OIDC network call when a token is already available#1396
2f0772dThanks @karthikscale3! - Track Vercel request IDs (x-vercel-id) on all workflow events for correlating request logs with workflow executions#1335
e902980Thanks @VaguelySerious! - Use undici dispatcher for queue client#1364
94c14c7Thanks @karthikscale3! - Strip only ref/payload fields from eventData when resolveData is 'none', preserving all other metadataUpdated dependencies [
2f0772d,94c14c7]: