Add failing tests for #643: hard stop casing mismatch#645
Draft
prompt-driven-github[bot] wants to merge 1 commit intomainfrom
Draft
Add failing tests for #643: hard stop casing mismatch#645prompt-driven-github[bot] wants to merge 1 commit intomainfrom
prompt-driven-github[bot] wants to merge 1 commit intomainfrom
Conversation
- Unit tests verifying _check_hard_stop detects STOP_CONDITION format - E2E tests verifying orchestrator halts on prompt-instructed output - Fix step 4 prompt to include STOP_CONDITION marker Tests fail on current code, confirming the bug: _check_hard_stop uses title-case comparisons that don't match the lowercase format the prompts instruct the LLM to output. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds failing tests that detect the bug reported in #643 —
_check_hard_stopuses title-case string matching that doesn't match the lowercaseSTOP_CONDITION:format the prompts instruct the LLM to output.Test Files
tests/test_issue_643_hard_stop_casing.pytests/test_e2e_issue_643_hard_stop_casing.pyPrompt Files
pdd/prompts/agentic_change_step4_clarify_LLM.prompt(added missingSTOP_CONDITION:marker)What This PR Contains
_check_hard_stopSTOP_CONDITION: Clarification neededto the step 4 promptRoot Cause
_check_hard_stop()atpdd/agentic_change_orchestrator.py:319,323checks for"Clarification Needed"and"Architectural Decision Needed"(title case), but the prompts instruct the LLM to outputSTOP_CONDITION: Clarification neededandSTOP_CONDITION: Architectural decision needed(lowercase). The step 4 prompt was also missing theSTOP_CONDITIONmarker entirely.Next Steps
_check_hard_stopdetect theSTOP_CONDITION:prefix format with case-insensitive matchingFixes #643
Generated by PDD agentic bug workflow