Skip to content

fix(vscuse): Auto-fix Basic_Custom_Engine_Azure_OpenAI_ts_remote_debug#16302

Open
xiaolang124 wants to merge 4 commits into
devfrom
auto-fix/Basic_Custom_Engine_Azure_OpenAI_ts_remote_debug/2026-07-07-5
Open

fix(vscuse): Auto-fix Basic_Custom_Engine_Azure_OpenAI_ts_remote_debug#16302
xiaolang124 wants to merge 4 commits into
devfrom
auto-fix/Basic_Custom_Engine_Azure_OpenAI_ts_remote_debug/2026-07-07-5

Conversation

@xiaolang124

Copy link
Copy Markdown
Contributor

VscUse Auto-Fix Results

Plan: Basic_Custom_Engine_Azure_OpenAI_ts_remote_debug
Status: ✅ FIXED (attempt 3/8)
Initial Report: Link
Final Report: Link

Iteration Summary

# Fix Applied Result Report
1 Removed stale dhash preconditions from step_c3e4c33c (New Project modal "Custom ❌ Failed Report
2 Inlined the debug_in_teams_remote group (plan_r_0930_063548) into the main plan ❌ Failed Report
3 Inlined the read-only validation_chat_data group (plan_r_1020_110153) into the m ✅ Passed Report

How to Review

  • Each commit represents one fix attempt for plans/Basic_Custom_Engine_Azure_OpenAI_ts_remote_debug.json
  • Compare the initial report with the final report to verify the fix
  • Check that coordinate/dhash changes are reasonable for the current VS Code layout

Changes Made to Test Plan

...Custom_Engine_Azure_OpenAI_ts_remote_debug.json | 499 ++++++++++++++++++++-
 1 file changed, 492 insertions(+), 7 deletions(-)
View diff
diff --git a/packages/tests/vscuse/vscode-test-cases/plans/Basic_Custom_Engine_Azure_OpenAI_ts_remote_debug.json b/packages/tests/vscuse/vscode-test-cases/plans/Basic_Custom_Engine_Azure_OpenAI_ts_remote_debug.json
index 1b3c69f..6aaec84 100644
--- a/packages/tests/vscuse/vscode-test-cases/plans/Basic_Custom_Engine_Azure_OpenAI_ts_remote_debug.json
+++ b/packages/tests/vscuse/vscode-test-cases/plans/Basic_Custom_Engine_Azure_OpenAI_ts_remote_debug.json
@@ -8,7 +8,7 @@
       "precondition_wait_timeout": 30,
       "precondition_retry_interval": 1
     },
-    "total_steps": 4,
+    "total_steps": 24,
     "created_at": "2025-11-14T05:50:41.381007",
     "name": "Basic Custom Engine Azure OpenAI ts Remote Debug",
     "description": {
@@ -29,11 +29,29 @@
       "plan_r_0929_040401",
       "plan_r_0928_073729",
       "plan_r_0928_075846",
-      "plan_r_0930_063548",
-      "plan_r_1020_110153"
+      "step_64456d0d",
+      "step_3fb94c2c",
+      "step_0f0c12ce",
+      "step_710f99f7",
+      "step_edc27950",
+      "step_5721b490",
+      "step_b2737c0c",
+      "step_ea74996b",
+      "step_82f6ba51",
+      "step_56f3a504",
+      "step_25ce8a2f",
+      "step_06f77d3f",
+      "step_d491dc74",
+      "step_6df62c65",
+      "step_8c6b26a7",
+      "step_6d3141f9",
+      "step_5793c327",
+      "step_5b2a3d32",
+      "step_d2127173",
+      "step_aef94205"
     ],
     "tags": [],
-    "updated_at": "2025-11-14T05:52:26.306047"
+    "updated_at": "2026-07-07T06:22:16.719423"
   },
   "steps": [
     {
@@ -57,9 +75,9 @@
       "continue_on_error": "0",
       "depends_on": [],
       "preconditions": [
-        "dhash:369:134:16:5:ca9629443bd8282a",
-        "dhash:369:134:96:5:6565293144c52723",
-        "dhash:369:134:0:10:c0c88094b2717075"
+        "dhash:369:134:16:5:eccb9c6854dad828",
+        "dhash:369:134:96:5:6565a83144c82582",
+        "dhash:369:134:0:10:c0c8889692b17075"
       ],
       "postconditions": [],
       "tags": [],
@@ -159,6 +177,473 @@
       "screenshot": "step_fe64ffbd",
       "created_at": "2025-11-14T05:50:41.468718",
       "plan_id": "plan_5b32a1a1"
+    },
+    {
+      "step_id": "step_64456d0d",
+      "agent": "interaction",
+      "tool": "key_press",
+      "parameters": {
+        "key": "f1"
+      },
+      "description": "Press the F1 key in Visual Studio Code to open the command palette.",
+      "content_refs": [],
+      "timeout": 30,
+      "retry_count": 0,
+      "continue_on_error": "false",
+      "depends_on": [],
+      "preconditions": [
+        "dhash:512:384:0:20:32832723b32c6c2b"
+      ],
+      "postconditions": [],
+      "tags": [],
+      "screenshot": "step_64456d0d",
+      "created_at": "2026-06-05T07:17:55.236797",
+      "plan_id": "plan_r_0930_063548"
+    },
+    {
+      "step_id": "step_3fb94c2c",
+      "agent": "interaction",
+      "tool": "type_text",
+      "parameters": {
+        "text": "Debug: Select and Start Debugging"
+      },
+      "description": "Type 
... (truncated, see commit diff for full changes)

Generated by vscuse-auto-fix.yml | model: claude-opus-4.8

github-actions Bot added 4 commits July 7, 2026 05:36
…c3e4c33c (New Project modal "Custom Engine Agent" click) that timed out due to a DHASH mismatch after the modal opened.
…n_r_0930_063548) into the main plan and fixed step_25ce8a2f to click the "Add"/"Open" button by removing its Add-only dhash preconditions (app already installed shows "Open").
…roup (plan_r_1020_110153) into the main plan and removed step_5793c327's stale all-zero dhash preconditions that caused the 30s precondition timeout on the Teams "Send a message" text box.
@github-actions

github-actions Bot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

✅ VscUse Test Plan — All tests passed

Why these tests: Selected 1 impacted test plan(s) changed in this PR (no product code modified).

Branch diff: auto-fix/Basic_Custom_Engine_Azure_OpenAI_ts_remote_debug/2026-07-07-5dev

Plans run:

  • Basic_Custom_Engine_Azure_OpenAI_ts_remote_debug

Step Status
1️⃣ Build VSIX (CD) ✅ Done
2️⃣ Build Docker image ✅ Done
3️⃣ Run UI tests ✅ All tests passed

🎯 Actual UI test run
🔗 Full pipeline results
📊 Detailed test report

ℹ️ How were these tests selected?

GitHub Copilot (Claude Sonnet 4.6, high reasoning) analysed the PR title, description, and the diff between
auto-fix/Basic_Custom_Engine_Azure_OpenAI_ts_remote_debug/2026-07-07-5 and dev
to pick the most relevant test plans from packages/tests/vscuse/Index.md.

@github-actions

github-actions Bot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

E2E Test Selection — AI Selected

Why these tests: The changed file is under packages/tests/vscuse/** (a VS Code UI test plan), which runs in a separate vscuse pipeline and requires no e2e test execution.

Cases selected (0):


View pipeline run

Need to run more tests?

Comment on this PR:

  • /e2e-run ./path/to/test.tests.ts — add specific cases to AI selection
  • /e2e-run-all — run all e2e cases

Then re-run the workflow.

@codecov

codecov Bot commented Jul 7, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 87.26%. Comparing base (e7cb00e) to head (d7d2341).
⚠️ Report is 3 commits behind head on dev.

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##              dev   #16302      +/-   ##
==========================================
- Coverage   87.27%   87.26%   -0.02%     
==========================================
  Files         631      631              
  Lines       33080    33084       +4     
  Branches     7713     7715       +2     
==========================================
- Hits        28871    28870       -1     
- Misses       2399     2401       +2     
- Partials     1810     1813       +3     

see 5 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant