Repository navigation
cics-crucible: mutate the four PC* ports; strengthened scenarios for pc-wizard and pc-aid-menu (Part of #4443) - #5392
Merged
Conversation
…pc-wizard and pc-aid-menu (Part of #4443) Mutation run (seed 0, 24 each, strengthened on): PCDETL 15/9, PCMENU 16/8, PCCONF 15/8, PCWIZ 16/7 (killed/survived). 36 first-run survivors, 6 case gaps; four new scenarios (expected logs derived from the COBOL) kill 4, the other two are equivalent / unreachable. 0 case gaps, 0 harness gaps remain. The four PC* names leave the proof_reach stale set; exact counts added. Evidence re-proven. Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Owner
Author
|
No description provided. |
1 similar comment
Owner
Author
|
No description provided. |
squid-protocol
marked this pull request as ready for review
October 18, 2026 00:04
squid-protocol
enabled auto-merge (squash)
October 18, 2026 00:05
Owner
Author
|
No description provided. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Part of #4443 (item 2). Item 1 merged as #5318.
What changed
pc-aid-menu) and PCCONF, PCWIZ (pc-wizard): seed 0, 24 mutants each, strengthened scenarios on, java-ported and java-facade sides. Killed/survived: PCDETL 15/9, PCMENU 16/8, PCCONF 15/8, PCWIZ 16/7 (PCCONF and PCWIZ one stillborn each).--derive-expected, never by hand) kill 4:enter-sends-no-data(PCMENU),amount-not-numeric,name-erased,amount-erased(PCCONF/PCWIZ).back-xctl-failsdrives the failing XCTL; its target mutant is equivalent. The other two case gaps were re-triaged (below).test_proof_reach.py: the four PC* names leave the stale set (the four PCIMM* stay), flagged survivors 5 to 6 (one more unreachable), exact counts in a new test.mutation_scores.json, the table inmutation_testing.md, the four evidence records (evidence.py prove).case.json,test_proof_reach.py,mutation_testing.mdprose.Class table: crucible ports with a recorded mutation run
Class: every CICS-crucible port must have a current mutation run, all survivors triaged, no case gap.
enter-sends-no-datakills the MAPFAIL mutanttest_the_re_run_crucible_ports_keep_their_measured_floorFinding
A cold start of PCCONF (PC03 typed at the terminal, EIBCALEN 0) diverges: the COBOL stub records no events, the port posts to PCLEDGER. DFHCOMMAREA is unaddressable on IBM there, so it is not a valid proof input; I left the scenario out and triaged the mutant it would have judged (
79fe0ecaad) unreachable with that reason. Not fixed here.Sibling gaps
test_proof_reach.pystale setca-xctl-versions)mutation_scores.json/tmprepro: scenarioPC03at terminal; baselinereport.jsonRemaining slices (#4443)
Item 3 (spot-check of the 35 equivalent verdicts); carddemo-acctview and carddemo-menu re-run; READ INTO LENGTH to LENGERR scenario (waits on the next cics-crucible release).
Gates
pr_gates.py --fast6/6,--ratchets8/8; pytest on proof_reach, test_evidence, tests/cics_crucible and the pre-PR set passes. After merging origin/main the four PC* records are stale on the generator only, like every other record (the scheduled job re-proves).Cross-repo
None.
Lessons for agents
crucible:prefix:crucible:<case>/<PROG>:<id>.evidence.py provefor that case's ports.the committed port is not proven) means port and COBOL disagree on that input: readbaseline/report.jsonbefore dropping it.pgrep -fcan match itself; watch log-line counts instead.🤖 Generated with Claude Code