Make eval configuration modular with set overrides and explicit relaxed matching - #6

Merged

jonabur merged 4 commits into

mainfrom

feature/per-eval-catalogue

Oct 2, 2026

Commits on Oct 2, 2026

Keep each eval's interpretation and language mappings in one YAML file
Jonathan Burdge
committed
837ffe3
Share language metadata and infer routine scope defaults
Jonathan Burdge
committed
2b2b2f6
Resolve catalogue defaults, eval-set overrides and language exclusions with explicit relaxed matching
Jonathan Burdge
committed
33bcc11
Group strict few-shot exclusions and avoid duplicate diagnostics
Jonathan Burdge
committed
9eb53b4