Skip to content

feat(cli): clarify telemetry identity and onboarding outcomes - #3064

Merged
OwenKephart merged 2 commits into
mainfrom
feat/cli-telemetry-context
Sep 8, 2026
Merged

feat(cli): clarify telemetry identity and onboarding outcomes#3064
OwenKephart merged 2 commits into
mainfrom
feat/cli-telemetry-context

Conversation

@OwenKephart

@OwenKephart OwenKephart commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Summary

CLI telemetry currently leaves two important dimensions ambiguous: identifiers in CI and Docker are intentionally regenerated per invocation, and failed initialization runs report only a terminal error. This adds an identity_kind field so analysis can distinguish ephemeral from persisted identifier semantics, and records the furthest reached stage for eve init, eve extension init, and the interactive eve dev --onboard handoff. The new fields are low-cardinality and preserve the policy boundary: they do not include error text, arguments, paths, package-manager output, user selections, or CI-provider identity.

Validation

  • pnpm --filter eve exec vitest run --config vitest.unit.config.ts src/cli/telemetry/index.test.ts src/cli/run.test.ts src/cli/dev/tui/runner.test.ts src/cli/dev/tui/tui.test.ts
  • pnpm typecheck
  • pnpm docs:check
  • Targeted oxfmt, oxlint, and git diff --check

Checklist

  • This change was requested or approved by a maintainer
  • I ran the relevant checks from CONTRIBUTING.md
  • I added tests and documentation where relevant
  • I added a changeset if this touches the published eve package
  • DCO sign-off passes for every commit (git commit --signoff)

@vercel

vercel Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
eve-docs Ready Ready Preview, v0 Sep 8, 2026 4:10pm UTC
eve-docs-4759 Error Error v0 Sep 8, 2026 4:10pm UTC
1 Skipped Deployment
Project Deployment Actions Updated
eve-pkg Skipped Skipped v0 Sep 8, 2026 4:10pm UTC

@github-actions

github-actions Bot commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Bundle + Package Summary: apps/fixtures/weather-agent

Key takeaways

  • No notable deltas vs main (9cb899d).

Delta vs main (9cb899d)

Area Metric Baseline Current Delta
Package Packed tarball 8.66 MB 8.67 MB +1.8 kB ⚠️
Package Unpacked publish size 32.63 MB 32.64 MB +4.7 kB ⚠️
Package Installed footprint 77.71 MB 77.72 MB +4.7 kB ⚠️
Package Published files 3853 3853 0
Package Installed files 7751 7751 0
Package Installed package instances 33 33 0
Package Distinct installed package names 32 32 0
Package Installed dependency edges 51 51 0
Package Installed optional peer edges 7 7 0
Runtime Unique function payloads 2 2 0
Runtime Total function bytes 20.74 MB 20.74 MB -80 B ✅
Runtime Public routes 18 18 0
Changed function payloads vs main (9cb899d) (2)
Function Status Baseline Current Delta Route changes
functions/__server.func changed 10.37 MB 10.37 MB -40 B ✅ none
functions/.well-known/workflow/v1/flow.func changed 10.37 MB 10.37 MB -40 B ✅ none

eve init install

Metric Baseline Current Delta
Installed footprint 116.15 MB 116.16 MB +4.7 kB ⚠️
Installed packages 113 113 0
dependencies 4 4 0
devDependencies 2 2 0
Dependency package bytes 48.76 MB 48.76 MB +4.7 kB ⚠️
devDependency package bytes 5.04 MB 5.04 MB 0 B ➖
Build Metadata
  • Preset: vercel
  • Nitro: nitro@3.0.260903-beta
  • Output directory: apps/fixtures/weather-agent/.vercel/output
  • Build metadata timestamp: 2026-09-08T16:11:44.685Z
  • Route aliases: 18 public, 1 internal (19 total aliases)
  • Vercel routes in config: 21
  • Severity legend: 🔴 dominant/large, 🟠 notable, 🟡 watch, ⚪ small
Package Drill-Down

Package Details

  • Package: eve@0.52.2
  • Package directory: packages/eve
  • Tarball: 8.67 MB (eve-0.52.2.tgz)
  • Unpacked payload: 32.64 MB across 3853 published files
  • Installed footprint: 77.72 MB across 7751 installed files
  • Installed root package: 31.21 MB
  • Installed dependencies: 46.51 MB
  • Installed package instances: 33
  • Distinct installed package names: 32
  • Installed dependency edges: 51
  • Installed optional peer edges: 7
  • Runtime dependencies: 2
  • Peer dependencies: 5 (4 optional)

Installed footprint is measured from an isolated temporary npm install of the packed tarball.
Graph metrics read only package.json files in package directories directly beneath a node_modules boundary, including nested boundaries. Each directory is one package instance; distinct names come from those manifests. Dependency edges count each unique name in dependencies or optionalDependencies per instance; optional peer edges count peerDependencies marked optional.

Heavy installed dependencies

  • eve: 31.21 MB (40.2%)
  • @rolldown/binding-linux-x64-gnu: 19.31 MB (24.9%)
  • ai: 7.01 MB (9.0%)
  • zod: 6.41 MB (8.3%)
  • undici: 3.51 MB (4.5%)
Publish payload breakdown
Published file size
🔴 dist/src/compiled/shadcn-registry/index.js       [#############...........] 9.76 MB 29.9%
🟠 dist/src/compiled/@photon-ai/chat-adapter-ime... [###.....................] 2.27 MB 7.0%
🟠 dist/src/compiled/@ai-sdk/code-mode/index.js     [#.......................] 1.03 MB 3.1%
🟡 dist/src/compiled/@vercel/blob/index.js          [#.......................] 901.4 kB 2.8%
🟡 dist/src/compiled/_chunks/workflow/signal-exi... [#.......................] 514.6 kB 1.6%
🔴 Other published files                            [########################] 18.17 MB 55.7%
Installed footprint breakdown
Installed package size
🔴 eve                             [########################] 31.21 MB 40.2%
🔴 @rolldown/binding-linux-x64-gnu [###############.........] 19.31 MB 24.9%
🔴 ai                              [#####...................] 7.01 MB 9.0%
🔴 zod                             [#####...................] 6.41 MB 8.3%
🟠 undici                          [###.....................] 3.51 MB 4.5%
🟠 nitro                           [#.......................] 1.89 MB 2.4%
🔴 Other installed packages        [######..................] 8.36 MB 10.8%
Runtime dependencies (2)
Package Range Notes
nitro 3.0.260903-beta
undici 8.9.0
Peer dependencies (5)
Package Range Notes
@opentelemetry/api ^1.0.0 optional peer
ai catalog:
braintrust ^3.0.0 optional peer
just-bash ^3.1.0 optional peer
microsandbox ^0.5.0 optional peer
eve init install drill-down

eve init install details

  • Command: eve init my-agent
  • Package manager: npm
  • Installed footprint: 116.16 MB across 9647 installed files
  • Installed packages: 113 total (107 transitive-only)
  • dependencies: 4 direct packages totaling 48.76 MB
  • devDependencies: 2 direct packages totaling 5.04 MB
  • Other transitive package files: 62.35 MB

Installed footprint is measured from an isolated temporary eve init my-agent using the current packed eve tarball.

Heavy installed dependencies

  • eve: 31.21 MB (26.9%)
  • @typescript/typescript-linux-x64: 27.95 MB (24.1%)
  • @rolldown/binding-linux-x64-gnu: 19.31 MB (16.6%)
  • zod: 10.37 MB (8.9%)
  • ai: 7.01 MB (6.0%)
Installed footprint breakdown
Installed package size
🔴 eve                              [########################] 31.21 MB 26.9%
🔴 @typescript/typescript-linux-x64 [#####################...] 27.95 MB 24.1%
🔴 @rolldown/binding-linux-x64-gnu  [###############.........] 19.31 MB 16.6%
🔴 zod                              [########................] 10.37 MB 8.9%
🔴 ai                               [#####...................] 7.01 MB 6.0%
🟠 undici                           [###.....................] 3.51 MB 3.0%
🔴 Other installed packages         [#############...........] 16.79 MB 14.5%
dependencies (4)
Package Range Installed size Share
@vercel/connect 1.0.0 167.9 kB 0.1%
ai ^7.0.82 7.01 MB 6.0%
eve file:eve-0.52.2.tgz 31.21 MB 26.9%
zod 4.5.4 10.37 MB 8.9%
devDependencies (2)
Package Range Installed size Share
@types/node 24.x 2.54 MB 2.2%
typescript 7.0.2 2.50 MB 2.2%
Function Drill-Down

Payload Size Graph

Unique function payload size and share of total
🔴 functions/.well-known/workflow/v1/flow.func     [########################] 10.37 MB 50.0%
🔴 functions/__server.func                         [########################] 10.37 MB 50.0%

Top Function Payloads

🟠 functions/.well-known/workflow/v1/flow.func • 1 public route • 10.37 MB
Metric Value
Public routes /.well-known/workflow/v1/flow
Runtime nodejs24.x
Handler index.mjs
Payload 10.37 MB
Function files 10.37 MB across 112 files
Traced dependencies 0 B
Signal 🟠 Bundled file index.mjs is 2.32 MB (22.4%)

🟠 🔎 Dependency Analysis

📦 Bundled files:

Bundled file size
🟠 index.mjs                        [###########.............] 2.32 MB 22.4%
🟡 _libs/undici.mjs                 [#####...................] 980.8 kB 9.5%
🟡 _chunks/esm-Fqlolk7e.mjs         [###.....................] 723.3 kB 7.0%
🟡 _chunks/chatgpt-model.mjs        [###.....................] 697.0 kB 6.7%
🟡 _chunks/signal-exit-Dsy-TT0V.mjs [###.....................] 616.2 kB 5.9%
🔴 Other bundled files              [########################] 5.03 MB 48.5%

🧾 Vercel Config

{
  "handler": "index.mjs",
  "launcherType": "Nodejs",
  "shouldAddHelpers": false,
  "supportsResponseStreaming": true,
  "runtime": "nodejs24.x",
  "maxDuration": "max",
  "experimentalTriggers": [
    {
      "type": "queue/v2beta",
      "topic": "__eve776561746865722d6167656e74_wkf_workflow_*",
      "consumer": "default",
      "retryAfterSeconds": 5,
      "initialDelaySeconds": 0
    }
  ],
  "environment": {
    "WORKFLOW_PRECONDITION_GUARD": "1"
  }
}

🟠 functions/__server.func • 17 public routes, 1 internal alias • 10.37 MB
Metric Value
Public routes /
/.well-known/workflow/v1/webhook/[token]
/eve/v1/activity/[token]
/eve/v1/callback/[token]
/eve/v1/connections/[name]/callback/[attemptId]/[token]
/eve/v1/connections/[name]/callback/[token]
/eve/v1/health
/eve/v1/info
/eve/v1/session
/eve/v1/session/[parentSessionId]/subagents/[callId]/[childSessionId]/stream
/eve/v1/session/[sessionId]
/eve/v1/session/[sessionId]/cancel
/eve/v1/session/[sessionId]/clear
/eve/v1/session/[sessionId]/compact
/eve/v1/session/[sessionId]/reset
/eve/v1/session/[sessionId]/stream
/eve/v1/task-input/[token]
Internal aliases /__server
Runtime nodejs24.x
Handler index.mjs
Payload 10.37 MB
Function files 10.37 MB across 112 files
Traced dependencies 0 B
Signal 🟠 Bundled file index.mjs is 2.32 MB (22.4%)

🟠 🔎 Dependency Analysis

📦 Bundled files:

Bundled file size
🟠 index.mjs                        [###########.............] 2.32 MB 22.4%
🟡 _libs/undici.mjs                 [#####...................] 980.8 kB 9.5%
🟡 _chunks/esm-Fqlolk7e.mjs         [###.....................] 723.3 kB 7.0%
🟡 _chunks/chatgpt-model.mjs        [###.....................] 697.0 kB 6.7%
🟡 _chunks/signal-exit-Dsy-TT0V.mjs [###.....................] 616.2 kB 5.9%
🔴 Other bundled files              [########################] 5.03 MB 48.5%

🧾 Vercel Config

{
  "handler": "index.mjs",
  "launcherType": "Nodejs",
  "shouldAddHelpers": false,
  "supportsResponseStreaming": true,
  "runtime": "nodejs24.x"
}

Build Timing: e2e/fixtures/agent-tools-sandbox

This is an informational timing measurement inside eve build, from preflight through publication. Output-size measurement and profile writing are excluded.

Build mode: deployable Vercel build with sandbox template prewarm included.

  • Build pipeline: 5.94 s -> 6.15 s (+216.0 ms) vs main (9cb899d).
  • Timing is informational: shared GitHub runners are too variable for a hard timing budget.
Detailed phase timings vs `main (9cb899d)`
Phase Baseline Current Delta
extension.check 13.5 ms 0.8 ms -12.7 ms
project.resolve 0.4 ms 0.4 ms 0.0 ms
workspace.create 0.7 ms 0.6 ms -0.1 ms
host.prepare 541.0 ms 818.0 ms +277.0 ms
vercel.service-prefix.resolve 2.4 ms 2.4 ms 0.0 ms
nitro.create 577.4 ms 585.3 ms +7.9 ms
sandbox.prewarm 271.6 ms 259.4 ms -12.2 ms
nitro.cache.prepare 0.3 ms 0.2 ms -0.1 ms
nitro.prepare 1.0 ms 1.0 ms 0.0 ms
nitro.public-assets 0.8 ms 0.8 ms 0.0 ms
nitro.prerender 0.5 ms 0.5 ms 0.0 ms
nitro.bundle 4.47 s 4.43 s -42.7 ms
nitro.cache.write 0.4 ms 0.4 ms 0.0 ms
vercel.workflow-function.materialize 50.8 ms 50.3 ms -0.5 ms
agent-summary.emit 0.8 ms 0.7 ms -0.1 ms
nitro.close 0.1 ms 0.1 ms 0.0 ms
output.publish 3.6 ms 3.5 ms -0.1 ms
workspace.remove 2.2 ms 2.2 ms 0.0 ms

@OwenKephart OwenKephart changed the title feat(cli): clarify telemetry identity and init outcomes feat(cli): clarify telemetry identity and onboarding outcomes Sep 4, 2026
@OwenKephart
OwenKephart force-pushed the feat/cli-telemetry-context branch from 0d3f648 to 8f24133 Compare September 4, 2026 21:40
Signed-off-by: owenkephart <owen.kephart@vercel.com>
@vercel-security-reviewer

Copy link
Copy Markdown

Security review details

Signed-off-by: owenkephart <owen.kephart@vercel.com>
@OwenKephart
OwenKephart merged commit 59ec96c into main Sep 8, 2026
119 of 120 checks passed
@OwenKephart
OwenKephart deleted the feat/cli-telemetry-context branch September 8, 2026 16:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants