Repository navigation
chore(ci): claims-drift job and weekly GitHub signals - #730
ajitpratap0 wants to merge 1 commit into
Conversation
Add a --claims mode to gen-readme-metrics that verifies llms.txt, the GitHub About text and benchmark dates against metrics.json, and a weekly workflow that runs it plus logs stars, traffic and referrers to a tracking issue. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01RkzVu3JY9Y6BRWfjesWts9
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
|
Claude finished @ajitpratap0's task in 28s —— View job PR review: claims-drift job and weekly signalsI read the diff only. I did not run the tests or the workflow. The design is sound. Making the check detect drift instead of storing an admin PAT is a good call. The tests cover the main mismatch cases. Using Issues and suggestions
SummaryItem 1 (the self-test) and item 2 (traffic failure handling) are the ones I'd fix before merge. The rest are optional polish. I can't push edits to |
Summary
--claims [--about "text"]toscripts/gen-readme-metrics: checks thatllms.txt(performance line, dialect count, SQL-99 estimate) and the GitHub About text agree withscripts/gen-readme-metrics/metrics.json, and fails whenmetrics.jsonorbenchmarks/compare/results/latest.jsonis older than the latest release tag.metrics.jsongainsmeasured_at(2026-10-13) so freshness is checkable..github/workflows/claims-drift.yml: runs the README check, a seeded-mismatch self-test, and the claims check against the live About text. A second job appends a weekly comment (stars, forks, and with the optionalSIGNALS_TOKENsecret: 14d views, clones, top referrers) to a "Weekly GitHub signals" tracking issue, created on first run. pkg.go.dev "Imported by" stays a manual note in each comment.GITHUB_TOKENcannot edit About, so the job only detects drift and fails; a maintainer updates About by hand. No admin PAT is stored.Heads up: the live About text currently says "1.5M+ ops/sec", so the first scheduled run will fail until About is updated by hand (e.g.
gh repo edit --description ...with a measured, stage-labelled figure or no number).Test Plan
task checkpassesgo test ./scripts/gen-readme-metrics/covers seeded llms.txt and About mismatches and stale datesgo run ./scripts/gen-readme-metrics --claimspasses; with--about "fast 1.5M+ ops/sec"it exits 1SIGNALS_TOKENsecret for traffic dataBreaking Changes
None.
Closes #684
Part of #634
🤖 Generated with Claude Code
https://claude.ai/code/session_01RkzVu3JY9Y6BRWfjesWts9