Repository navigation
Conversation
This was referenced Nov 19, 2026
xeophon
marked this pull request as ready for review
November 19, 2026 01:13
Contributor
ApprovabilityVerdict: Approved at Macroscope's review found this PR approvable — This updates an integration-test prompt to request only required shell arguments. File-content rewards and multi-turn trace checks remain unchanged, with no production behavior changes. Notes:
No code changes detected at You can add or adjust custom eligibility rules. Learn more. |
xeophon
force-pushed
the
codex/3205-multi-turn-fixture
branch
from
November 19, 2026 01:30
0b124b9 to
e62406e
Compare
xeophon
force-pushed
the
codex/3205-stirrup-acp
branch
from
November 19, 2026 01:30
80c1fbc to
d9f718a
Compare
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Ask the model to supply only the arguments required to run the shell command. Claude Code can convert an optional quoted Bash timeout into a number during replay, which genuinely changes the tool call. The fixture still checks the file contents, reward, and branch count.
Local unit suite on this commit reported 299 passed, 19 skipped. Full-stack CI before review fixes
Layer 10 of 13. Builds on #3216. Stack index
Note
Require shell arguments in the Multi-Turn fixture task prompt
Updates the task prompt in
EchoAgenticTaskset.loadin echo_agentic.py to instruct the agent to use only the arguments required to run the command, alongside the existing write-to-file and finish steps.Macroscope summarized e62406e.
Note
Low Risk
Test-only prompt wording in an integration fixture; no production logic or reward behavior changes.
Overview
The echo-agentic integration fixture now tells the agent to use only the arguments required to run the shell command when writing the target file, in addition to the existing write-and-finish instructions.
This tightens the Multi-Turn fixture prompt so replay does not diverge when runtimes or clients normalize optional bash parameters (e.g. quoted timeouts) into different tool calls. Scoring and artifacts are unchanged—the reward still checks file contents via
wrote_phrase.Reviewed by Cursor Bugbot for commit e62406e. Bugbot is set up for automated code reviews on this repo. Configure here.