Ask for the wheel by calling for it, not by asking in words - #80
Open
rhlsthrm wants to merge 1 commit into
Open
Conversation
Handing the browser over is a tool call. A sentence in the transcript is not one: nothing is offered, nobody can help, and the page stays where it is. The guidance said to call computer_request_help at a sign-in, which is true but not emphatic enough to beat the obvious-looking alternative, so Bots wrote "please sign in and let me know" and stopped. Worse, one went on to ask for a username and password to be typed into a sign-in page the person cannot see, which the prompt already forbids in the narrow form of telling the Bot a secret. So: calling it IS how you ask, the sentences that are not it are named, and the reason is given — the person is not looking at this page and cannot type into it until control is handed over. The tool description says the same thing, since that is what the model weighs when choosing.
rhlsthrm
requested review from
MikeRyanDev,
davidmckayv,
guidovizoso and
tylerslaton
as code owners
August 21, 2026 09:42
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What this changes
Handing the browser over is a tool call. A sentence in the transcript is not one: nobody is offered the wheel, the person has no way to help, and the page stays exactly where it was.
The guidance already said to call
computer_request_helpat a sign-in, which is correct but was not emphatic enough to beat the obvious-looking alternative. Observed on a running deployment, asked to file an issue on GitHub while signed out, three attempts in a row:The second one is the serious one. The prompt already forbids asking to be told a secret, and the model obeyed that narrowly while asking the person to type their password into a page they cannot see and are not looking at — which is both useless and exactly the habit this product exists to remove.
So the guidance now says calling it is what asking means, names the sentences that are not it, and gives the reason rather than only the rule: the person is not looking at this page and cannot type into it until control is handed over. The tool description says the same, since that is what a model weighs when it chooses between talking and calling.
No code paths change — the prompt and one tool description.
Where it runs
ComputerViewprompt.Boundary and audit
computer_request_helpwas always registered and always went through the same path; this only makes a Bot actually reach for it.computer.help_requested,computer.control_takenandcomputer.control_releasedare existing events that now get written where previously a Bot wrote a sentence and stopped.Changelog
Unreleased→Fixed.Proof
Biome lint and format clean on both files.
On a running deployment, fresh thread, one plain request and no coaching — "File an issue on github.com/CopilotKit/openbot titled 'Test from OpenBot' with a one-line body." The Bot navigated, snapshotted, hit the sign-in wall and called the tool on its own:
Ten seconds from the page load to the wheel being offered, where three exchanges previously ended in a Bot asking for a password.
Composes with #79 but does not depend on it: on
mainthis reaches the two shipped Bots, which already import the guidance. #79 is what puts the same guidance in front of built-in agents, and the run above is a built-in agent with both applied.