Skip to content

fix: require committed evaluation packets - #51

Draft
ConnorBritain wants to merge 1 commit into
mainfrom
codex/evaluation-packet-contract
Draft

fix: require committed evaluation packets#51
ConnorBritain wants to merge 1 commit into
mainfrom
codex/evaluation-packet-contract

Conversation

@ConnorBritain

Copy link
Copy Markdown
Owner

What changed

  • Require documentation-only Cloud evaluators to make one local, inbox-only packet commit so Codex Cloud can return the artifact diff.
  • Keep push, PR creation, production authentication, and any non-inbox changes prohibited.
  • Define the minimum packet metadata and per-evidence provenance required for collection.
  • Add a regression test for the generated evaluator contract.

Why

Untracked evidence files are not exposed by Codex Cloud's diff handoff. This caused completed packets to be uncollectable until the lead intervened.

Validation

  • npm test — 355 passed.
  • npm run validate is intentionally inapplicable in the Roadmap source repository because it requires a consumer repository's docs/roadmap/roadmap.yaml.

@coderabbitai

coderabbitai Bot commented Aug 16, 2026

Copy link
Copy Markdown

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: cd547cc5-9ef4-47be-a9e8-18bc883205f3

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant