Skip to content

Add a metadata-injection mutation to the CLI challenge #29

Description

@Victoria824

Why

The web playground demonstrates untrusted glossary text attempting to disable policy checks. The CLI mutation suite should produce the same release-blocking evidence.

Acceptance criteria

  • Add a deterministic metadata-injection mutation in src/queryassure/challenge.py
  • Treat retrieved descriptions and glossary text as data, never policy instructions
  • Emit a named failure gate and sanitized evidence
  • Add a focused regression test
  • Update the challenge documentation and expected mutation count

The test must not call a live model provider.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions