Skip to content

fix(eve): preserve dynamic tool schema validation - #3021

Draft
vercel-gh-bot-2[bot] wants to merge 1 commit into
mainfrom
e0/54aa362a-35db-482a-97d4-100b2c2720d1
Draft

fix(eve): preserve dynamic tool schema validation#3021
vercel-gh-bot-2[bot] wants to merge 1 commit into
mainfrom
e0/54aa362a-35db-482a-97d4-100b2c2720d1

Conversation

@vercel-gh-bot-2

Copy link
Copy Markdown
Contributor

Dynamic tools now replay their original live schemas, so runtime transformations and refinements survive metadata serialization.

Why

Dynamic tool metadata retained only a JSON Schema snapshot. Rebuilding a tool from that snapshot created a new validator and silently discarded runtime semantics such as Zod .trim(), transforms, and refinements. The focused regression accepted whitespace that the original schema rejected.

Approach

Bind each original live schema to its concrete metadata record in a process-scoped WeakMap. Durable metadata keeps the JSON Schema snapshot plus a marker that live validation is required.

When metadata crosses a serialization boundary, lifecycle hydration resolves the tool definition again and transfers the new schema binding to the persisted metadata record. Missing bindings fail closed instead of falling back to weaker JSON Schema validation. An eve-owned Standard Schema adapter preserves Zod 3 validation while retaining the durable JSON Schema snapshot.

resolver -> live schema -> metadata snapshot + live marker
                      -> WeakMap<metadata record, live schema>

replay -> metadata record -> bound live schema -> tool validation

Object identity scopes bindings to one metadata record, so same-named tools from different sessions cannot share validators.

Validation

  • Before the fix, the regression accepted { value: " " } after replay
  • Focused lifecycle and schema tests: 79 passed
  • Full unit suite with a 10-second timeout: 7,992 passed, 1 skipped
  • Default 5-second unit timeout: 7,990 passed, 2 load-sensitive timeouts; both affected suites passed in isolation, 46 passed
  • pnpm --filter eve typecheck
  • pnpm fmt --check on all changed files
  • pnpm exec oxlint on all changed TypeScript files
  • git diff --check

AI assistance: e0 implemented the change and ran an independent code review.

Closes #3019

Requested by: JonaCodes

Co-authored-by: JonaCodes <11865013+JonaCodes@users.noreply.github.com>
@vercel

vercel Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
eve-docs Ready Ready Preview Sep 4, 2026 7:09am UTC
eve-docs-4759 Ready Ready Preview, v0 Sep 4, 2026 7:09am UTC
eve-pkg Ready Ready Preview Sep 4, 2026 7:09am UTC

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Bundle + Package Summary: apps/fixtures/weather-agent

Key takeaways

  • No notable deltas vs main (eb5949a).

Delta vs main (eb5949a)

Area Metric Baseline Current Delta
Package Packed tarball 8.64 MB 8.64 MB +1.7 kB ⚠️
Package Unpacked publish size 32.53 MB 32.53 MB +5.0 kB ⚠️
Package Installed footprint 77.69 MB 77.70 MB +5.0 kB ⚠️
Package Published files 3821 3823 +2
Package Installed files 7667 7669 +2
Package Installed package instances 35 35 0
Package Distinct installed package names 34 34 0
Package Installed dependency edges 53 53 0
Package Installed optional peer edges 47 47 0
Runtime Unique function payloads 2 2 0
Runtime Total function bytes 20.52 MB 20.53 MB +6.7 kB ⚠️
Runtime Public routes 18 18 0
Changed function payloads vs main (eb5949a) (2)
Function Status Baseline Current Delta Route changes
functions/__server.func changed 10.26 MB 10.26 MB +3.3 kB ⚠️ none
functions/.well-known/workflow/v1/flow.func changed 10.26 MB 10.26 MB +3.3 kB ⚠️ none

eve init install

Metric Baseline Current Delta
Installed footprint 116.13 MB 116.14 MB +5.0 kB ⚠️
Installed packages 115 115 0
dependencies 4 4 0
devDependencies 2 2 0
Dependency package bytes 48.62 MB 48.63 MB +5.0 kB ⚠️
devDependency package bytes 5.04 MB 5.04 MB 0 B ➖
Build Metadata
  • Preset: vercel
  • Nitro: nitro@3.0.260610-beta
  • Output directory: apps/fixtures/weather-agent/.vercel/output
  • Build metadata timestamp: 2026-09-04T07:17:29.173Z
  • Route aliases: 18 public, 1 internal (19 total aliases)
  • Vercel routes in config: 21
  • Severity legend: 🔴 dominant/large, 🟠 notable, 🟡 watch, ⚪ small
Package Drill-Down

Package Details

  • Package: eve@0.51.1
  • Package directory: packages/eve
  • Tarball: 8.64 MB (eve-0.51.1.tgz)
  • Unpacked payload: 32.53 MB across 3823 published files
  • Installed footprint: 77.70 MB across 7669 installed files
  • Installed root package: 31.10 MB
  • Installed dependencies: 46.60 MB
  • Installed package instances: 35
  • Distinct installed package names: 34
  • Installed dependency edges: 53
  • Installed optional peer edges: 47
  • Runtime dependencies: 2
  • Peer dependencies: 5 (4 optional)

Installed footprint is measured from an isolated temporary npm install of the packed tarball.
Graph metrics read only package.json files in package directories directly beneath a node_modules boundary, including nested boundaries. Each directory is one package instance; distinct names come from those manifests. Dependency edges count each unique name in dependencies or optionalDependencies per instance; optional peer edges count peerDependencies marked optional.

Heavy installed dependencies

  • eve: 31.10 MB (40.0%)
  • @rolldown/binding-linux-x64-gnu: 19.31 MB (24.9%)
  • ai: 6.99 MB (9.0%)
  • zod: 6.41 MB (8.3%)
  • undici: 3.50 MB (4.5%)
Publish payload breakdown
Published file size
🔴 dist/src/compiled/shadcn-registry/index.js       [#############...........] 9.76 MB 30.0%
🟠 dist/src/compiled/@photon-ai/chat-adapter-ime... [###.....................] 2.27 MB 7.0%
🟠 dist/src/compiled/@ai-sdk/code-mode/index.js     [#.......................] 1.03 MB 3.2%
🟡 dist/src/compiled/@vercel/blob/index.js          [#.......................] 901.8 kB 2.8%
🟡 dist/src/compiled/_chunks/workflow/undici-Dfx... [#.......................] 512.5 kB 1.6%
🔴 Other published files                            [########################] 18.06 MB 55.5%
Installed footprint breakdown
Installed package size
🔴 eve                             [########################] 31.10 MB 40.0%
🔴 @rolldown/binding-linux-x64-gnu [###############.........] 19.31 MB 24.9%
🔴 ai                              [#####...................] 6.99 MB 9.0%
🔴 zod                             [#####...................] 6.41 MB 8.3%
🟠 undici                          [###.....................] 3.50 MB 4.5%
🟠 nitro                           [##......................] 2.41 MB 3.1%
🔴 Other installed packages        [######..................] 7.97 MB 10.3%
Runtime dependencies (2)
Package Range Notes
nitro 3.0.260610-beta
undici 8.9.0
Peer dependencies (5)
Package Range Notes
@opentelemetry/api ^1.0.0 optional peer
ai catalog:
braintrust ^3.0.0 optional peer
just-bash ^3.1.0 optional peer
microsandbox ^0.5.0 optional peer
eve init install drill-down

eve init install details

  • Command: eve init my-agent
  • Package manager: npm
  • Installed footprint: 116.14 MB across 9565 installed files
  • Installed packages: 115 total (109 transitive-only)
  • dependencies: 4 direct packages totaling 48.63 MB
  • devDependencies: 2 direct packages totaling 5.04 MB
  • Other transitive package files: 62.47 MB

Installed footprint is measured from an isolated temporary eve init my-agent using the current packed eve tarball.

Heavy installed dependencies

  • eve: 31.10 MB (26.8%)
  • @typescript/typescript-linux-x64: 27.95 MB (24.1%)
  • @rolldown/binding-linux-x64-gnu: 19.31 MB (16.6%)
  • zod: 10.37 MB (8.9%)
  • ai: 6.99 MB (6.0%)
Installed footprint breakdown
Installed package size
🔴 eve                              [########################] 31.10 MB 26.8%
🔴 @typescript/typescript-linux-x64 [######################..] 27.95 MB 24.1%
🔴 @rolldown/binding-linux-x64-gnu  [###############.........] 19.31 MB 16.6%
🔴 zod                              [########................] 10.37 MB 8.9%
🔴 ai                               [#####...................] 6.99 MB 6.0%
🟠 undici                           [###.....................] 3.50 MB 3.0%
🔴 Other installed packages         [#############...........] 16.91 MB 14.6%
dependencies (4)
Package Range Installed size Share
@vercel/connect 1.0.0 167.9 kB 0.1%
ai ^7.0.82 6.99 MB 6.0%
eve file:eve-0.51.1.tgz 31.10 MB 26.8%
zod 4.5.4 10.37 MB 8.9%
devDependencies (2)
Package Range Installed size Share
@types/node 24.x 2.54 MB 2.2%
typescript 7.0.2 2.50 MB 2.2%
Function Drill-Down

Payload Size Graph

Unique function payload size and share of total
🔴 functions/.well-known/workflow/v1/flow.func     [########################] 10.26 MB 50.0%
🔴 functions/__server.func                         [########################] 10.26 MB 50.0%

Top Function Payloads

🟠 functions/.well-known/workflow/v1/flow.func • 1 public route • 10.26 MB
Metric Value
Public routes /.well-known/workflow/v1/flow
Runtime nodejs24.x
Handler index.mjs
Payload 10.26 MB
Function files 10.26 MB across 112 files
Traced dependencies 0 B
Signal 🟠 Bundled file index.mjs is 2.23 MB (21.7%)

🟠 🔎 Dependency Analysis

📦 Bundled files:

Bundled file size
🟠 index.mjs                   [###########.............] 2.23 MB 21.7%
🟡 _libs/undici.mjs            [#####...................] 980.5 kB 9.6%
🟡 _chunks/esm-CE0tAvRh.mjs    [####....................] 723.5 kB 7.0%
🟡 _chunks/chatgpt-model.mjs   [###.....................] 696.5 kB 6.8%
🟡 _chunks/frames-Boesh7kU.mjs [###.....................] 680.2 kB 6.6%
🔴 Other bundled files         [########################] 4.96 MB 48.3%

🧾 Vercel Config

{
  "handler": "index.mjs",
  "launcherType": "Nodejs",
  "shouldAddHelpers": false,
  "supportsResponseStreaming": true,
  "runtime": "nodejs24.x",
  "maxDuration": "max",
  "experimentalTriggers": [
    {
      "type": "queue/v2beta",
      "topic": "__eve776561746865722d6167656e74_wkf_workflow_*",
      "consumer": "default",
      "retryAfterSeconds": 5,
      "initialDelaySeconds": 0
    }
  ],
  "environment": {
    "WORKFLOW_PRECONDITION_GUARD": "1"
  }
}

🟠 functions/__server.func • 17 public routes, 1 internal alias • 10.26 MB
Metric Value
Public routes /
/.well-known/workflow/v1/webhook/[token]
/eve/v1/activity/[token]
/eve/v1/callback/[token]
/eve/v1/connections/[name]/callback/[attemptId]/[token]
/eve/v1/connections/[name]/callback/[token]
/eve/v1/health
/eve/v1/info
/eve/v1/session
/eve/v1/session/[parentSessionId]/subagents/[callId]/[childSessionId]/stream
/eve/v1/session/[sessionId]
/eve/v1/session/[sessionId]/cancel
/eve/v1/session/[sessionId]/clear
/eve/v1/session/[sessionId]/compact
/eve/v1/session/[sessionId]/reset
/eve/v1/session/[sessionId]/stream
/eve/v1/task-input/[token]
Internal aliases /__server
Runtime nodejs24.x
Handler index.mjs
Payload 10.26 MB
Function files 10.26 MB across 112 files
Traced dependencies 0 B
Signal 🟠 Bundled file index.mjs is 2.23 MB (21.7%)

🟠 🔎 Dependency Analysis

📦 Bundled files:

Bundled file size
🟠 index.mjs                   [###########.............] 2.23 MB 21.7%
🟡 _libs/undici.mjs            [#####...................] 980.5 kB 9.6%
🟡 _chunks/esm-CE0tAvRh.mjs    [####....................] 723.5 kB 7.0%
🟡 _chunks/chatgpt-model.mjs   [###.....................] 696.5 kB 6.8%
🟡 _chunks/frames-Boesh7kU.mjs [###.....................] 680.2 kB 6.6%
🔴 Other bundled files         [########################] 4.96 MB 48.3%

🧾 Vercel Config

{
  "handler": "index.mjs",
  "launcherType": "Nodejs",
  "shouldAddHelpers": false,
  "supportsResponseStreaming": true,
  "runtime": "nodejs24.x"
}

Build Timing: e2e/fixtures/agent-tools-sandbox

This is an informational timing measurement inside eve build, from preflight through publication. Output-size measurement and profile writing are excluded.

Build mode: deployable Vercel build with sandbox template prewarm included.

  • Build pipeline: 2.44 s -> 2.44 s (-4.7 ms) vs main (eb5949a).
  • Timing is informational: shared GitHub runners are too variable for a hard timing budget.
Detailed phase timings vs `main (eb5949a)`
Phase Baseline Current Delta
extension.check 11.9 ms 12.5 ms +0.6 ms
project.resolve 0.3 ms 0.3 ms 0.0 ms
workspace.create 0.6 ms 7.8 ms +7.2 ms
host.prepare 483.5 ms 405.3 ms -78.2 ms
vercel.service-prefix.resolve 1.3 ms 1.3 ms 0.0 ms
nitro.create 423.8 ms 390.8 ms -33.0 ms
sandbox.prewarm 294.0 ms 331.2 ms +37.2 ms
nitro.cache.prepare 0.2 ms 0.2 ms 0.0 ms
nitro.prepare 0.6 ms 0.5 ms -0.1 ms
nitro.public-assets 0.6 ms 0.6 ms 0.0 ms
nitro.prerender 0.4 ms 0.3 ms -0.1 ms
nitro.bundle 1.17 s 1.19 s +28.0 ms
nitro.cache.write 0.3 ms 0.3 ms 0.0 ms
vercel.workflow-function.materialize 40.0 ms 64.9 ms +24.9 ms
agent-summary.emit 0.6 ms 0.6 ms 0.0 ms
nitro.close 0.1 ms 0.1 ms 0.0 ms
output.publish 15.3 ms 23.9 ms +8.6 ms
workspace.remove 1.4 ms 1.4 ms 0.0 ms

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Dynamic tools lose Zod schema transformations during replay

0 participants