Skip to content

Re-home the catalog retrieval benchmark from amicissimo (audit #850 lens 2) #855

Description

@aarontrowbridge

Important

Problemamicissimo/scripts/retrieve.jl + benchmarks/retrieval/ (qrels.jsonl, run.jl, metrics.jl, CI retrieval-benchmark.yml) implement the public amico catalog verb's retrieval semantics (platform/gate filter, fidelity rank, duration tie-break — catalog_verb.ts/repertoire.ts in amicode) and guard them with a regression benchmark — but they live on the PRIVATE side. A public verb's contract test belongs with the verb (ruling 7: 'most things in amicode').
Approach — Re-home the benchmark (qrels + metrics + the CI lane) into amicode next to the catalog verb, wired as its regression gate; amicissimo keeps nothing after the move (the private copy deletes at the re-home's merge). Verify the two implementations' semantics match first — the audit found them to be second-implementations of one contract; the re-home should leave ONE implementation of record (the public one) with the benchmark pointing at it.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    hitlNeeds human decision or review

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions