Skip to content

docs(design): the hidden suite's count and validations after round 3's extension - #1850

Merged
braboj merged 1 commit into
mainfrom
docs/efficacy-suite-count
Sep 25, 2026
Merged

braboj merged 1 commit into
mainfrom
docs/efficacy-suite-count

Conversation

@braboj

@braboj braboj commented Sep 24, 2026

Copy link
Copy Markdown
Collaborator

Part of #1767. Design §11 still gave round 1's 377 checks and five mutations. It now gives the round-3 figures, measured 2026-09-24 against braboj/tariff-hidden-suite 65bfb9a:

  • 534 build checks and 74 change checks
  • a reference implementation that passes the build checks
  • a second implementation, with the change task made, that passes the change checks
  • 12 of 12 mutations caught
  • the pre-round-3 reference, which has no sign-in, fails the sign-in module

Smoke passes (0 failed). Conformance: 0 failed, after moving one historical figure out of an unmeasured line. No changelog entry: this is the repository's own design document.

🤖 Generated with Claude Code

…s extension

Design §11 still gave round 1's 377 checks and five mutations. It now
gives the measured round-3 figures: 534 build checks and 74 change
checks. The validations are the reference, the reference with the change
made, twelve caught mutations, and the no-sign-in control.

Part of #1767.

Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
@braboj
braboj merged commit 463f8c1 into main Sep 25, 2026
1 check passed
@braboj
braboj deleted the docs/efficacy-suite-count branch September 25, 2026 08:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant