Repository navigation
fix(ai-red-teaming): ATLAS objective aliases + auto-exec backstop - #201
Merged
Merged
Conversation
- generate_atlas_attack: normalize objective aliases (id<-name/objective_id, goal<-description/objective/prompt) and give a per-object error naming the missing field, instead of rejecting near-miss schemas with a terse message. - _auto_execute_workflow: lower the default subprocess timeout 3600s -> 1200s as a backstop so a stalled run can't block the tool for a full hour. - bump version 1.20.1 -> 1.20.2 for manifest sync.
1 task
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Reliability fixes for ATLAS / multistep runs against the mesh environments, found during live finops-mesh demos.
generate_atlas_attackrejected near-miss objective schemas with a terse "requires non-empty 'id', 'category', 'goal'". Now normalizes common aliases (id←name/objective_id,goal←description/objective/prompt) and returns a per-object error naming the missing field. (This stalled the ai-red-teaming agent mid-run.)_auto_execute_workflowdefault subprocess timeout 3600s→1200s so a stalled run can't block the tool for a full hour.Pairs with dreadnode-tiger PR (ATLAS no-progress break) which fixes the "burns full budget on refusals / keeps running after findings land" slowness.
Validation
attack_runner.pycompiles.Test plan