Skip to content

fix(spec): let claude reviews finish and name failure evidence - #13

Merged
decebal merged 1 commit into
mainfrom
fix/spec-review-deadline
Nov 9, 2026
Merged

decebal merged 1 commit into
mainfrom
fix/spec-review-deadline

Conversation

@decebal

@decebal decebal commented Nov 9, 2026

Copy link
Copy Markdown
Contributor

Summary

  • allstack spec review --host claude timed out at 240s on a 217-line production plan (all-source docs/plans/2026-11-08-fly-cost-reduction.md). Deadline is now 280s, below the 290s limit on the enclosing operation.
  • The reviewer prompt limits checks to 12 code locations and requires naming anything left unchecked, because host output only appears on completion.
  • A failed review now reports exit state and the process evidence directory. It previously ended with an empty path when host stderr was empty.

Trade-off

The 12-location limit applies to both hosts, so a review of a code-heavy plan can leave claims unchecked. The report must list them. In the verification run, Claude checked 7 locations and listed 6 unchecked items.

Test plan

  • cargo fmt --check
  • cargo clippy --all-targets -- -D warnings
  • cargo test: all pass, 2 ignored because they require real Chronis
  • tests/spec.rs asserts exit state, a real result.json under the named evidence path, and the prompt limit
  • Real run on the plan above with --host claude: 203s, receipt written, verdict findings
  • A real timeout on the new binary; the message path is covered with a failing fake host only

🤖 Generated with Claude Code

`allstack spec review --host claude` timed out at its 240-second deadline
on a 217-line production plan, and the failure message ended with an
empty path because a timed-out host has empty stderr.

Raise the review deadline to 280 seconds, below the 290-second limit on
the enclosing operation, and limit the reviewer to 12 code locations so
it reports before the deadline. Record the process evidence directory on
`Outcome` and include exit state and that directory in the error.

Verified: the same plan now completes on the Claude host in 203s with a
receipt. Full test suite and clippy pass.
@decebal
decebal marked this pull request as ready for review November 9, 2026 11:35
@decebal
decebal merged commit 973293b into main Nov 9, 2026
2 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant