[claude-code-user-docs-review] 🔍 Claude Code User Documentation Review - 2026-06-04 #36916
Closed
Replies: 1 comment
-
|
This discussion has been marked as outdated by Claude Code User Documentation Review. A newer discussion is available at Discussion #37113. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Executive Summary
A developer who uses Claude Code and avoids all GitHub Copilot products can adopt gh-aw — there are no hard blockers. A complete Claude-only path exists (pick Claude in the wizard or set
engine: claude, supplyANTHROPIC_API_KEY, rungh aw init --engine claude), all 15 documented tools are engine-agnostic, and 63 Claude workflow examples ship in the repo. Key finding: the single biggest friction for this persona is thatCLAUDE_CODE_OAUTH_TOKENis explicitly unsupported (auth.mdx:121-123) — Claude Code users who expect to reuse their Claude Max/Teams subscription OAuth must instead obtain a pay-as-you-goANTHROPIC_API_KEY, and this caveat is buried in the auth reference rather than surfaced in Quick Start.Persona Context
Severity Findings
No 🚫 Critical Blockers were found — a Claude Code user can complete onboarding end-to-end.
M1 —
CLAUDE_CODE_OAUTH_TOKENis unsupported and the caveat is not surfaced where Claude Code users will look.docs/.../reference/auth.mdx:121-123: "CLAUDE_CODE_OAUTH_TOKENis not supported... The only supported authentication method for the Claude engine isANTHROPIC_API_KEY. Provider-based OAuth (Claude Teams or Claude Max subscription) is not supported... it will be ignored." A Claude Code user's mental model is "I already authenticate Claude Code with my subscription token." They will reach forCLAUDE_CODE_OAUTH_TOKEN, watch it be silently ignored, and have no signpost in Quick Start. Fix: add a one-line callout inquick-start.mdxnext to theANTHROPIC_API_KEYNOTE (quick-start.mdx:84-88): "Claude subscription / Claude Code OAuth tokens are not supported — use an API key."M2 — Copilot is the silent default engine;
gh aw initproduces Copilot-specific artifacts unless--engine claudeis passed.how-they-work.mdx:26: "Workflows support GitHub Copilot (default)..." andcli.md:135/cli.md:139: "use--engineto select a non-Copilot engine and skip Copilot-specific artifacts" /gh aw init --engine claude # Skip Copilot-specific artifacts. Quick Start never mentionsgh aw init --engine claude, so a Claude user following Quick Start gets Copilot scaffolding by default. Fix: surface--engine claudein the Quick Start install/init step.M3 — Quick Start framing is Copilot-first.
quick-start.mdx:71listsCOPILOT_GITHUB_TOKENfirst in the secret step, and the dedicated setup NOTE forCOPILOT_GITHUB_TOKEN(quick-start.mdx:77-82) precedes theANTHROPIC_API_KEYNOTE (quick-start.mdx:84-88). The Copilot token also carries extra burden (a separate fine-grained PAT with Copilot Requests: Read), which a non-Copilot reader may assume is mandatory. Fix: reorder or add "pick the one matching your AI account" guidance so Copilot isn't implied as required.💡 Minor Confusion (paper cuts) — 3
m1 — Example imbalance. Repo ships 126 Copilot vs 63 Claude workflow examples (~2:1). Plenty of Claude coverage, but Copilot-dominant sample browsing reinforces a Copilot-first impression.
m2 — No "why Claude instead of Copilot?" guidance and no engine capability/comparison matrix in the intro docs. A Claude Code user gets no explicit reassurance that Claude is a first-class, fully-capable engine.
m3 — Inline secret callouts in Quick Start exist only for Copilot and Claude. Codex (
OPENAI_API_KEY) and Gemini (GEMINI_API_KEY) are link-only (quick-start.mdx:71). Minor for the Claude persona, but inconsistent.Engine Comparison
Ratings: ⭐ scale 1–5 (Setup ease for a non-Copilot user, Example availability, Auth clarity). Data from sub-agent scans of
.github/workflows/*.md,tools.md,quick-start.mdx, andauth.mdx.COPILOT_GITHUB_TOKEN, Copilot Requests: Read).ANTHROPIC_API_KEYonly. Subscription/OAuth not supported. Must opt out of Copilot default.OPENAI_API_KEY(orCODEX_API_KEY); no inline Quick Start callout.shared/genaiscript.md; no dedicated secret documented; auth described vaguely.Tool Availability
Per
tool-engine-classifierscan ofreference/tools.md: all 15 documented tools/config entries are engine-agnostic. Zero copilot-only, claude-only, or codex-only tools.agentic-workflows,playwright,github,bash,edit,web-fetch,web-search,cache-memory,repo-memory,qmd,cli-proxy,mcp-servers+ timeout/startup-timeout/registry → all engine-agnostic.copilottool — "copilot" appears only as anengine:value, never undertools:. Nothing is gated to Copilot.web-searchis disabled by default on Codex (tools.md:67); timeout defaults differ (Claude 60s / Codex 120s, tools.md:157).Verdict for the persona: tooling is fully available to Claude users. ✅
Authentication Gaps
From
auth-doc-extractor(reference/auth.mdxis the authoritative source;quick-start.mdxlinks to it):COPILOT_GITHUB_TOKEN(fine-grained PAT, user account, Copilot Requests: Read)ANTHROPIC_API_KEYOPENAI_API_KEY/CODEX_API_KEY; optionalAZURE_OPENAI_API_KEYGaps for Claude Code users:
CLAUDE_CODE_OAUTH_TOKENexplicitly ignored (auth.mdx:121-123) — not mentioned in Quick Start (see M1).ANTHROPIC_BASE_URLcustom-endpoint path is documented (auth.mdx:119) — good for enterprise proxies.ANTHROPIC_API_KEYsetup is now covered inline in Quick Start (quick-start.mdx:84-88) — an improvement over the 2026-06-01 review where it was reported buried.Example Parity
engine-example-counterover.github/workflows/*.md(string + objectengine:forms merged, body snippets excluded):Parity verdict: Claude has ample, varied examples (63) covering CI, auditing, reporting, and smoke tests. No capability is Claude-exclusive or Claude-excluded. The 2:1 Copilot:Claude ratio is a perception issue, not a functional gap.
Recommended Actions
Priority 1 (address the persona's #1 wall):
ANTHROPIC_API_KEYNOTE stating thatCLAUDE_CODE_OAUTH_TOKEN/ Claude subscription tokens are not supported and an API key from console.anthropic.com is required (targets M1).Priority 2 (reduce Copilot-default friction):
2. Surface
gh aw init --engine claudein Quick Start so non-Copilot users don't get Copilot scaffolding (M2).3. Rebalance Quick Start step 3 / engine-selection framing so no single engine reads as required (M3).
Priority 3 (polish):
4. Add a short "Choosing an engine" / capability-parity note reassuring users Claude is first-class (m2).
5. Add inline Codex/Gemini secret callouts for consistency (m3); optionally add a Claude-first example to the guides.
Conclusion
Can Claude Code users adopt gh-aw? — Yes. There are no critical blockers: the engine, tooling, auth, and examples all fully support a Copilot-free, Claude-only workflow. The friction is framing (Copilot-as-default) and one genuine trap — subscription/OAuth tokens don't work, only
ANTHROPIC_API_KEYdoes — that isn't surfaced where this persona will hit it.Overall score: 7.5 / 10 (stable vs the 2026-06-01 review; the inline
ANTHROPIC_API_KEYQuick Start callout is a real improvement, but theCLAUDE_CODE_OAUTH_TOKENgap and Copilot-default framing remain).References:
Beta Was this translation helpful? Give feedback.
All reactions