Skip to content

fix(eval): reject reused instances in manual PortSwigger ablations - #144

Merged
elementalsouls merged 1 commit into
elementalsouls:mainfrom
rudycelekli:rudy/cbh-port-swigger-distinct-manual-labs
Nov 16, 2026
Merged

elementalsouls merged 1 commit into
elementalsouls:mainfrom
rudycelekli:rudy/cbh-port-swigger-distinct-manual-labs

Conversation

@rudycelekli

Copy link
Copy Markdown
Contributor

The manual ablation runner allowed the same lab instance to appear in both conditions or multiple cases. A prior run can change challenge state and invalidate the next measurement. Reject reused hostnames before invoking the oracle or agent.

Verification

Offline eval discovery and harness sanity. The regression submits the same hostname with case, port and trailing-slash differences.

@elementalsouls
elementalsouls merged commit ee6d0fd into elementalsouls:main Nov 16, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants