Skip to content

feat(server): add evaluation timing observability#240

Draft
abhinav-galileo wants to merge 18 commits into
mainfrom
abhi/agent-control-eval-observability
Draft

feat(server): add evaluation timing observability#240
abhinav-galileo wants to merge 18 commits into
mainfrom
abhi/agent-control-eval-observability

Conversation

@abhinav-galileo

Copy link
Copy Markdown
Collaborator

Summary:

  • Adds timing metrics around evaluation execution stages.
  • Adds tracing spans around engine and Luna evaluator paths.
  • Adds optional Luna HTTP phase and client timing diagnostics.

Validation:

  • git diff --check passed for the split diff.
  • make engine-test did not reach tests because uv timed out fetching greenlet from the package index.

- Verify TLS against an optional CA bundle (ca_file arg or GALILEO_LUNA_CA_FILE) so internal API endpoints with internally-issued certificates work in internal auth mode.
- Bound connection pooling (keepalive expiry 1s, connection limits) so requests do not reuse sockets the server already closed, and retry the idempotent scorer invoke once on connection errors.
- Deprecate GALILEO_LUNA_AUTH_MODE; the auth mode is inferred from the configured credential, and setting both credentials remains an explicit error.
- Trim whitespace when resolving API base URLs from the environment.
- Update the Luna example README and cover URL precedence, TLS, retry, and deprecation with tests.
@abhinav-galileo abhinav-galileo changed the title feat: add evaluation timing observability feat(server): add evaluation timing observability Jun 15, 2026
@abhinav-galileo abhinav-galileo force-pushed the abhi/agent-control-runtime-tuning branch from a3606fa to 9b234e4 Compare June 15, 2026 16:02
@abhinav-galileo abhinav-galileo force-pushed the abhi/agent-control-eval-observability branch from 364f753 to 5a546cf Compare June 15, 2026 16:06
@codecov

codecov Bot commented Jun 15, 2026

Copy link
Copy Markdown

@abhinav-galileo abhinav-galileo force-pushed the abhi/agent-control-runtime-tuning branch from 35a12c1 to 664a78f Compare June 17, 2026 12:37
Base automatically changed from abhi/agent-control-runtime-tuning to main June 17, 2026 15:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant