Repository navigation
Use Meta Muse Ember for the e2e language model - #193
Merged
Merged
Conversation
Local runs default to meta/muse-ember-1.0. Language-model calls send OpenAI reasoning effort low so that model spends fewer output tokens on reasoning. Co-authored-by: Jonathan Beckman <jonathantbeckman@gmail.com>
jonbeckman
marked this pull request as ready for review
November 9, 2026 22:15
jonbeckman
enabled auto-merge (squash)
November 9, 2026 22:16
Contributor
TegamiThis repository uses Tegami to manage releases. When your changes affect published packages, add a changelog file under Create a changelog → · Changelog format Release preview
This PR does not add changelog files. Pending changelogs from other branches are included in the preview above. Run Managed by Tegami. |
Contributor
🟢 e2e solzero-core: 32 passed4 agent steps · 4 replayed from cache Change 5 files changed since All 32 tests in 13 files
e2e 0.21.3 · 3m 16s · local-cloudflare · run artifacts |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Local e2e runs now default the language model to
meta/muse-ember-1.0. Ids that do not start withanthropic/already go throughopenai.chat()on the Cloudflare AI Gateway/ai/v1route, soscripts/e2e/models.tschanges only that constant.E2E_DECISION_MODELis unchanged.Language-model calls already forward
agents.default.providerOptionsintogenerateText: field text in@e2e-dev/decision(askText) andwaitFor/extractin the e2e runner. This setsproviderOptions.openai.reasoningEfforttolow. Installedai7.0.152 documents a top-levelreasoningsetting, and@ai-sdk/openai4.0.101 mapsproviderOptions.openai.reasoningEffortonto Chat Completionsreasoning_effort(that provider option wins when both are set). The runner only forwardsproviderOptions, so that is the option those call sites can carry. The decision model does not receive it.The organization Actions variable
E2E_LANGUAGE_MODELis not changed. CI keeps using that variable until it is set tometa/muse-ember-1.0.release:none: this is an internal test-harness change. It does not change the product for users, administrators, or deployment operators, so there is no.tegami/entry.Call site
e2e.config.ts:scripts/e2e/models.ts:Proof
Same prompt, gateway id
default, modelmeta/muse-ember-1.0, credentialCF_AI_GATEWAY_E2E_TOKEN.CLOUDFLARE_API_TOKENwas not used.Prompt: a library has 240 books, one quarter are checked out, and one third of the remainder are reserved. Reply with only the number.
reasoning_effortsentreasoning_tokenscompletion_tokensreasoningEffort: "low"lowBoth responses were HTTP 200 with no SDK warnings. Low effort is honored, and on this prompt most completion tokens are still reasoning tokens (154 of 164, then 108 of 118).
Validation
nub run config:checknub run typechecknub run lintnub run formatnub run test: 30 passed, 2 failed (13 files, 32 tests). The runner selectedopenai.chat/meta/muse-ember-1.0.The two failures are
opencode executes a real promptandcodex executes a real prompt. Both timed out after 180s because the container proxy could not program iptables in this VM (RULE_APPEND failed, missing kernel module). The isolate prompt test and the rest of the core suite passed. Four recordedagent.actsteps replayed.Checklist
.tegami/release entry, or explained why this pull request usesrelease:none.nub run config:check,nub run typecheck,nub run lint,nub run format, andnub run test.THIRD_PARTY_NOTICES.mdfor new third-party code or separately licensed assets.