Repository navigation
feat(ci): Add CI failure RCA dispatch workflow - #110471
Closed
hubertdeng123 wants to merge 2 commits into
Closed
hubertdeng123 wants to merge 2 commits into
hubertdeng123 wants to merge 2 commits into
Conversation
Adds a workflow_dispatch workflow that scans recent CI failures (configurable 5-20), spins up a Coder workspace, and runs a Claude Code agent to perform root cause analysis across multiple failures. Produces structured reports with cross-failure pattern analysis, prioritized action items, and posts results as GitHub issues and optionally to Slack. Uses coder/setup-action for CLI setup and authentication.
github-actions
Bot
added
the
Scope: Backend
GitHub Actions output is sufficient for now. Removes the notify_slack input, Slack webhook secret dependency, and the Slack posting step.
Contributor
|
This pull request has gone three weeks without activity. In another week, I will close it. But! If you comment or otherwise update it, I will reset the clock, and if you add the label "A weed is but an unloved flower." ― Ella Wheeler Wilcox 🥀 |
This branch was successfully deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds a
workflow_dispatchworkflow that automatically scans recent CI failures and performs root cause analysis using a Claude Code agent running inside a Coder workspace.Motivation: When CI is broken and deploys are blocked, engineers spend significant time manually triaging failures — checking if they're flaky tests, code regressions, or infrastructure issues. This automates that investigation across multiple failures at once, identifying patterns and prioritizing action items.
How it works:
coder/setup-action, SSHs in, and runs Claude Code with a structured prompt. The agent checks out failing commits, reads test code, attempts reproduction, and produces a structured JSON report with root causes ranked by blast radius.Configurable inputs:
failure_count(5-20): How many recent failures to analyzeworkflow_filter:all/backend/frontend/acceptancebranch_filter: Scope to a specific branch (e.g.master)severity:deploy-blocked/flaky-investigation/generalnotify_slack: Force Slack notificationRequired secrets:
CODER_SESSION_TOKEN,CI_FAILURES_SLACK_WEBHOOK(optional)Modeled after the Coder preview workspace pattern in #109729.