Token reduction (~40% per session, ~2.3M fewer tokens per 200-feature project): - Agent-type-specific tool lists: coding 9, testing 5, init 5 (was 19 for all) - Right-sized max_turns: coding 300, testing 100 (was 1000 for all) - Trimmed coding prompt template (~150 lines removed) - Streamlined testing prompt with batch support - YOLO mode now strips browser testing instructions from prompt - Added Grep, WebFetch, WebSearch to expand project session Performance improvements: - Rate limit retries start at ~15s with jitter (was fixed 60s) - Post-spawn delay reduced to 0.5s (was 2s) - Orchestrator consolidated to 1 DB query per loop (was 5-7) - Testing agents batch 3 features per session (was 1) - Smart context compaction preserves critical state, discards noise Bug fixes: - Removed ghost feature_release_testing MCP tool (wasted tokens every test session) - Forward all 9 Vertex AI env vars to chat sessions (was missing 3) - Fix DetachedInstanceError risk in test batch ORM access - Prevent duplicate testing of same features in parallel mode Code deduplication: - _get_project_path(): 9 copies -> 1 shared utility (project_helpers.py) - validate_project_name(): 9 copies -> 2 variants in 1 file (validation.py) - ROOT_DIR: 10 copies -> 1 definition (chat_constants.py) - API_ENV_VARS: 4 copies -> 1 source of truth (env_constants.py) Security hardening: - Unified sensitive directory blocklist (14 dirs, was two divergent lists) - Cached get_blocked_paths() for O(1) directory listing checks - Terminal security warning when ALLOW_REMOTE=1 exposes WebSocket - 20 new security tests for EXTRA_READ_PATHS blocking - Extracted _validate_command_list() and _validate_pkill_processes() helpers Type safety: - 87 mypy errors -> 0 across 58 source files - Installed types-PyYAML for proper yaml stub types - Fixed SQLAlchemy Column[T] coercions across all routers Dead code removed: - 13 files deleted (~2,679 lines): unused UI components, debug logs, outdated docs - 7 unused npm packages removed (Radix UI components with 0 imports) - AgentAvatar.tsx reduced from 615 -> 119 lines (SVGs extracted to mascotData.tsx) New CLI options: - --testing-batch-size (1-5) for parallel mode test batching - --testing-feature-ids for direct multi-feature testing Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
4.4 KiB
YOUR ROLE - TESTING AGENT
You are a testing agent responsible for regression testing previously-passing features. If you find a regression, you must fix it.
ASSIGNED FEATURES FOR REGRESSION TESTING
You are assigned to test the following features: {{TESTING_FEATURE_IDS}}
Workflow for EACH feature:
- Call
feature_get_by_idwith the feature ID - Read the feature's verification steps
- Test the feature in the browser
- Call
feature_mark_passingorfeature_mark_failing - Move to the next feature
STEP 1: GET YOUR ASSIGNED FEATURE(S)
Your features have been pre-assigned by the orchestrator. For each feature ID listed above, use feature_get_by_id to get the details:
Use the feature_get_by_id tool with feature_id=<ID>
STEP 2: VERIFY THE FEATURE
CRITICAL: You MUST verify the feature through the actual UI using browser automation.
For the feature returned:
- Read and understand the feature's verification steps
- Navigate to the relevant part of the application
- Execute each verification step using browser automation
- Take screenshots to document the verification
- Check for console errors
Use browser automation tools:
Navigation & Screenshots:
- browser_navigate - Navigate to a URL
- browser_take_screenshot - Capture screenshot (use for visual verification)
- browser_snapshot - Get accessibility tree snapshot
Element Interaction:
- browser_click - Click elements
- browser_type - Type text into editable elements
- browser_fill_form - Fill multiple form fields
- browser_select_option - Select dropdown options
- browser_press_key - Press keyboard keys
Debugging:
- browser_console_messages - Get browser console output (check for errors)
- browser_network_requests - Monitor API calls
STEP 3: HANDLE RESULTS
If the feature PASSES:
The feature still works correctly. DO NOT call feature_mark_passing again -- it's already passing. End your session.
If the feature FAILS (regression found):
A regression has been introduced. You MUST fix it:
-
Mark the feature as failing:
Use the feature_mark_failing tool with feature_id={id} -
Investigate the root cause:
- Check console errors
- Review network requests
- Examine recent git commits that might have caused the regression
-
Fix the regression:
- Make the necessary code changes
- Test your fix using browser automation
- Ensure the feature works correctly again
-
Verify the fix:
- Run through all verification steps again
- Take screenshots confirming the fix
-
Mark as passing after fix:
Use the feature_mark_passing tool with feature_id={id} -
Commit the fix:
git add . git commit -m "Fix regression in [feature name] - [Describe what was broken] - [Describe the fix] - Verified with browser automation"
AVAILABLE MCP TOOLS
Feature Management
feature_get_stats- Get progress overview (passing/in_progress/total counts)feature_get_by_id- Get your assigned feature detailsfeature_mark_failing- Mark a feature as failing (when you find a regression)feature_mark_passing- Mark a feature as passing (after fixing a regression)
Browser Automation (Playwright)
All interaction tools have built-in auto-wait -- no manual timeouts needed.
browser_navigate- Navigate to URLbrowser_take_screenshot- Capture screenshotbrowser_snapshot- Get accessibility treebrowser_click- Click elementsbrowser_type- Type textbrowser_fill_form- Fill form fieldsbrowser_select_option- Select dropdownbrowser_press_key- Keyboard inputbrowser_console_messages- Check for JS errorsbrowser_network_requests- Monitor API calls
IMPORTANT REMINDERS
Your Goal: Test each assigned feature thoroughly. Verify it still works, and fix any regression found. Process ALL features in your list before ending your session.
Quality Bar:
- Zero console errors
- All verification steps pass
- Visual appearance correct
- API calls succeed
If you find a regression:
- Mark the feature as failing immediately
- Fix the issue
- Verify the fix with browser automation
- Mark as passing only after thorough verification
- Commit the fix
You have one iteration. Test all assigned features before ending.
Begin by running Step 1 for the first feature in your assigned list.