Skip to content

docs(job-assessment): add architecture, setup and tested prompts - #27

Merged
darthrootbeer merged 4 commits into
mainfrom
docs/ja-architecture-setup-prompts
Oct 2, 2026
Merged

darthrootbeer merged 4 commits into
mainfrom
docs/ja-architecture-setup-prompts

Conversation

@darthrootbeer

@darthrootbeer darthrootbeer commented Oct 2, 2026 •

Copy link
Copy Markdown
Owner

Context

Last package of the public job assessment system (JBSR-099). The chain already ran offline; what was missing was the docs a stranger needs and prompts that were actually tested, not just written.

Changes

  • New ARCHITECTURE.md (every scoring and verdict rule, a worked example, 14 interpretations) and SETUP.md (five-minute install, Claude Code wiring, troubleshooting).
  • README rewritten: what it is, what you get, a quickstart verified from a clean clone, the lesson (the model writes findings, scripts check, score and decide, shown with the recorded live-run miss), honest framing and what it does not prove.
  • Ten prompts in prompts/, each shown as a block in the docs. tests/test_prompt_blocks.py fails if a block and its file differ, a doc lacks its prompt section or Tested-on line, or a prompt has no saved run and grade.
  • Every prompt run on Sonnet and Haiku through the claude CLI. Records and grades in tests/prompt-runs/ (GRADES.md), earlier versions kept. Sonnet passed all ten; Haiku passed eight and partly passed two (Fix errors, and Customize to my background).
  • Sanitization: two setup-specific needles removed from a parse_posting test, a hand redaction noted in a live-run record, a wrong relative path fixed in the hooks README. Top-level README and ROADMAP lines that called the docs unfinished are corrected.

Review notes

Private gate (cet-gate.sh) was not available in this session, so it was not run.

🤖 Generated with Claude Code

https://claude.ai/code/session_01XV3Ggh86cf2xwUyz28XaN6

  • Docs updated

darthrootbeer and others added 4 commits October 1, 2026 19:27
…action

Drop two needles from the parse_posting path test that described one
machine's setup, and say in the live-run record that one tool-output path
was replaced by hand.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01XV3Ggh86cf2xwUyz28XaN6
Work in progress: prompt 02 is still being rerun on both models.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01XV3Ggh86cf2xwUyz28XaN6
Prompt 02 rerun to completion on both models; grades and tested-on lines
now reflect every final run.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01XV3Ggh86cf2xwUyz28XaN6
A second Opus read of every saved run found four grades the records did
not support. Haiku is now partial on the profile-building prompt, the
isolation claim is narrowed, and an over-broad path scrub is fixed.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01XV3Ggh86cf2xwUyz28XaN6
@darthrootbeer
darthrootbeer merged commit 590a0dd into main Oct 2, 2026
6 checks passed
@darthrootbeer
darthrootbeer deleted the docs/ja-architecture-setup-prompts branch October 2, 2026 01:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant