You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Track the remaining work to complete the AgentV Phoenix integration after the initial adapter and Phase A OTel preset work.
Context
Draft PR #1280 is the seed/handoff PR. It adds the planning document and first supported user-facing slice: agentv eval --export-otel --otel-backend phoenix plus documentation. It does not close this parent issue.
This parent issue covers the follow-up implementation issues needed before the Phoenix integration can be called complete.
Scope
Complete the integration as two intentionally bounded surfaces:
Phoenix OTLP observability for normal AgentV eval runs.
A Phoenix dataset/experiment adapter that keeps AgentV eval YAML and AgentV scoring semantics authoritative.
Users can use the documented Phoenix OTel preset for normal eval observability.
Adapter support gaps are explicit and conservative.
Phoenix experiments run real AgentV targets before claiming target parity.
AgentV scoring semantics remain authoritative for AgentV-authored evals.
Full dry-run parity is green or has documented exclusions.
Live Phoenix verification covers both OTLP export and at least one experiment path.
Maintainers can tell whether the adapter is intentionally private or publishable.
Non-goals
Do not replace AgentV's local result JSONL/artifact model with Phoenix.
Do not make Phoenix a required dependency for normal eval execution.
Do not reimplement workspace lifecycle, Docker sandboxing, target matrices, trials, or custom assertion discovery inside Phoenix unless a later concrete issue proves it is required.
Objective
Track the remaining work to complete the AgentV Phoenix integration after the initial adapter and Phase A OTel preset work.
Context
Draft PR #1280 is the seed/handoff PR. It adds the planning document and first supported user-facing slice:
agentv eval --export-otel --otel-backend phoenixplus documentation. It does not close this parent issue.This parent issue covers the follow-up implementation issues needed before the Phoenix integration can be called complete.
Scope
Complete the integration as two intentionally bounded surfaces:
Subissues
Recommended sequencing:
Acceptance Signals
Non-goals