Skip to content

fix: Use TestAgentPromptConfig type#997

Merged
rasmi merged 1 commit intoPAIR-code:mainfrom
jimbojw:fix-test-agent-prompt-config-type
Feb 9, 2026
Merged

fix: Use TestAgentPromptConfig type#997
rasmi merged 1 commit intoPAIR-code:mainfrom
jimbojw:fix-test-agent-prompt-config-type

Conversation

@jimbojw
Copy link
Collaborator

@jimbojw jimbojw commented Feb 7, 2026

Update testAgentConfig() method to use TestAgentPromptConfig type.

@jimbojw jimbojw marked this pull request as ready for review February 7, 2026 13:56
@jimbojw jimbojw requested review from rasmi and vivtsai February 7, 2026 13:56
@jimbojw
Copy link
Collaborator Author

jimbojw commented Feb 7, 2026

@rasmi Not sure how this happened. In PR #955, you had renamed BaseAgentPromptConfig to TestAgentPromptConfig, but somehow there's a lingering BaseAgentPromptConfig reference in experiment.manager.ts as of now.

This PR corrects the situation, but it's not clear to me how the codebase could have come to be in this state? As is, the frontend doesn't build, so one would expect that whatever combination of PRs led to this state should have failed the GitHub Actions checks.

@rasmi
Copy link
Collaborator

rasmi commented Feb 7, 2026

#912 didn't properly merge / rebase the changes from the chat refactor (looks like this just happened yesterday): 7823b27

@mkbehr -- there was a pretty substantial chat refactor, I think #912 can be simplified a bit!

@jimbojw
Copy link
Collaborator Author

jimbojw commented Feb 7, 2026

Thanks Rasmi, you're right, that was the cause of the regression.

I think I found the root cause that prevented GitHub Actions from detecting the issue. Our ci.yaml runs npm test for the frontend workspace, BUT it doesn't actually run npm build. It does build both utils and functions, just not frontend.

So, if I understand correctly, as long as the frontend tests only touch buildable code, they can run and pass. Since the offending line was in a file outside the tested files' dependency trees, the build failure wasn't caught.

I'm writing up a GitHub Issue to track this CI enhancement/bug.

@jimbojw jimbojw mentioned this pull request Feb 7, 2026
@rasmi
Copy link
Collaborator

rasmi commented Feb 7, 2026

Very curious!! I would have expected local building or type-checking to catch this, but I realize it's because I always develop with the hot reload server running, so it's always building locally. But not necessarily on GH actions / after merges in main. Good catch 🙏

@rasmi
Copy link
Collaborator

rasmi commented Feb 7, 2026

I wonder if we should adjust the CI commands so that test is always build+test (never just test alone)? Or just add a separate build step like the others have?

@jimbojw
Copy link
Collaborator Author

jimbojw commented Feb 7, 2026

@rasmi Either way would work. I tend to prefer to have GitHub Action steps be more atomic. That makes it easier to see which step failed when investigating. I've written up my proposal for building the frontend in #998.

@rasmi rasmi mentioned this pull request Feb 7, 2026
4 tasks
@jimbojw
Copy link
Collaborator Author

jimbojw commented Feb 7, 2026

@rasmi As I see it, for this issue (the TestAgentPromptConfig regression) we have three paths forward:

  1. Merge this PR to fix the immediate build problem.
  2. Rollback Improve API key testing. #912 to fix the immediate build problem.
  3. Develop a new PR to address the simplifications you mentioned that should now be possible.

Thoughts?

@rasmi
Copy link
Collaborator

rasmi commented Feb 7, 2026

I feel fine just merging this fix and sending a follow-up for the other comments (can take care of it later)! Defer to you!

@rasmi rasmi merged commit a79951d into PAIR-code:main Feb 9, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants