[AIGTWY-4759] Add fixture-driven managed-config integration tests - #703
Closed
david-siqi-liu wants to merge 2 commits into
Closed
david-siqi-liu wants to merge 2 commits into
david-siqi-liu wants to merge 2 commits into
Conversation
The managed lanes 403'd because the managed workspace IP-blocked GitHub runners; that is fixed config-side (the E2E_ADMIN_* secrets repointed to runner-reachable ca-central plus a published CodingAgentConfig). This makes the lanes work and widens their coverage: - Install both agent CLIs in each managed lane, since a managed config enables both agents and `ug configure` applies it to every enabled agent (each lane previously installed only its own agent and failed configuring the other). - Add a managed idempotency CUJ: two `ug configure` runs apply the admin config to both enabled agents identically, which also guards the all-enabled-agents apply. Deterministic config-file assertions, no extra TUI. - Keep the lanes non-blocking until this path is proven stable on ca-central. Co-authored-by: Isaac <no-reply@databricks.com>
david-siqi-liu
force-pushed
the
david/aigtwy-4759-managed-fixture-tests
branch
from
September 17, 2026 02:49
032d5e4 to
af3abe6
Compare
Introduce a `managed_fixture` layer that injects the admin CodingAgentConfig via the built-in UCODE_MANAGED_CONFIG_STUB hook, so the real ug and agent CLIs are exercised across managed-config shapes the live workspace does not publish. Auth, normalization, config writers, and the binaries stay real; the fetch/wire contract stays covered by the un-stubbed `managed` tests. - Seed CUJs: enabled_agents allowlist, tracing on/off OTEL env, default_agent validation. - Run in the existing managed lanes via a `(managed or managed_fixture)` marker filter. - Sanction the input-only stub in tests/AGENTS.md and tests/CLAUDE.md. Co-authored-by: Isaac <no-reply@databricks.com>
david-siqi-liu
force-pushed
the
david/aigtwy-4759-managed-fixture-tests
branch
from
September 17, 2026 02:57
af3abe6 to
5c9ca2c
Compare
david-siqi-liu
force-pushed
the
david/aigtwy-4759-managed-diagnostics
branch
from
September 17, 2026 03:11
de07883 to
8a9ee0d
Compare
Collaborator
Author
|
Rolled into #699 as a single combined PR (both-agents fix + managed tests + the managed_fixture layer). |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Stacked on #699 (parent). Adds a
managed_fixtureintegration layer that injects the admin CodingAgentConfig via the built-inUCODE_MANAGED_CONFIG_STUBhook, so the real ug and agent CLIs are exercised across managed-config shapes the live ca-central workspace does not publish. Auth, normalization, config writers, and the agent binaries stay real; the fetch/wire contract stays covered by the un-stubbedmanagedtests.Seed batch (CUJ table to follow as it expands):
Policy: sanctioned the input-only stub in tests/AGENTS.md and tests/CLAUDE.md; runs in the existing managed lanes via a
(managed or managed_fixture)marker filter.This pull request and its description were written by Isaac.