Varin/benchmark changes - #24

Open

varin-nair-factory wants to merge 33 commits into

devfrom

varin/benchmark-changes

Commits on Jan 13, 2026

remove P2/P3 suppression instruction
varin-nair-factory
committed
49a967c
add import verification step
varin-nair-factory
committed
23e8f1f
Add structured analysis phases
varin-nair-factory
committed
e422d6a
Add Thorough Analysis Checklist
varin-nair-factory
committed
d0d4251
consolidate instructions into structured phases and remove redundant sections
varin-nair-factory
committed
26c5252
remove contradicting instructions about resolving existing threads
varin-nair-factory
committed
45cb5b5
reorganize Phase 3, remove duplicates, fix diff position params
varin-nair-factory
committed
38af5d4
Add robustness improvements to review prompt
varin-nair-factory
committed
2ff53b2
Consolidate inline comment tool guidance with multi-line support
varin-nair-factory
committed
49df74b

Commits on Jan 14, 2026

Refine code review prompt to improve precision
varin-nair-factory
committed
b8d9301
Use local /review prompt
varin-nair-factory
committed
37d9992

Commits on Jan 15, 2026

Revert "Use local /review prompt"
varin-nair-factory
committed
ae1f3e4
add no pager to get full diff, exclude P2/P3 issues
varin-nair-factory
committed
afc66a4
Add common analysis patterns for reviews
varin-nair-factory
committed
0983d10
Pre-compute PR diff and comments, enforce thorough review with xhigh reasoning
varin-nair-factory
committed
cbbe3c1
remove revoking of gh app token
varin-nair-factory
committed
e53cbd8
switch gpt-5.2 reasoning effort back to high
varin-nair-factory
committed
9ffb2ed

Commits on Jan 21, 2026

fix tests
varin-nair-factory
committed
86ec277
test validator run
varin-nair-factory
committed
5da3f3f
increase candidate volume/coverage
varin-nair-factory
committed
a7066fb

Commits on Jan 22, 2026

Commits on Jan 23, 2026

improvements to candidate and validator prompts
varin-nair-factory
committed
56ab298

Commits on Jan 27, 2026

add common classes of bugs to candidate prompt
varin-nair-factory
committed
b89f550
old validator prompt
varin-nair-factory
committed
2ad2164

Commits on Jan 28, 2026