summaryrefslogtreecommitdiff
path: root/tests/claude-code
AgeCommit message (Collapse)Author
2026-03-09fix: replace bare except with except Exceptiondaniel-graham
Co-authored-by: daniel-graham <daniel-graham@users.noreply.github.com>
2026-03-06Add end-to-end tests for document review systemJesse Vincent
2026-03-06refactor: restructure specs and plans directoriesJesse Vincent
- Specs (brainstorming output) now go to docs/superpowers/specs/ - Plans (writing-plans output) now go to docs/superpowers/plans/ - User preferences for locations override these defaults - Update all skill references and test files Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-29docs: change main branch red flag to require explicit user consentCL Kao
Instead of prohibiting main branch work entirely, allow it with explicit user consent. This is more flexible while still ensuring users are aware of the implications. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-29test: add Test 9 - main branch red flag warningCL Kao
TDD: Test verifies that subagent-driven-development skill warns against starting implementation directly on main/master branch. Test expects skill to recommend worktree or feature branch instead. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-29test: add worktree requirement test for subagent-driven-developmentCL Kao
Add Test 8 to verify that using-git-worktrees is mentioned as a required skill for subagent-driven-development. This test will initially fail per TDD approach - the skill file needs to be updated to pass this test. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-29fix(tests): handle case variations in skill recognition testCL Kao
The assertion now matches "subagent-driven-development", "Subagent-Driven Development", and "Subagent Driven" since Claude's responses may use different casing and formatting styles. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2025-12-17Add token usage analysis to subagent-driven-development testJesse Vincent
- Rewrote analyze-token-usage.py to parse main session file correctly - Extracts usage from toolUseResult fields for each subagent - Shows breakdown by agent with descriptions - Integrated into test-subagent-driven-development-integration.sh - Displays token usage automatically after each test run
2025-12-17fix: verify skill usage via session transcript not text outputJesse Vincent
The skill instructions are internal and don't appear in user-facing output. Updated verification to parse the session JSONL transcript and check for actual tool usage: - Skill tool invocation - Task tool (subagents) - TodoWrite (tracking) - Implementation results
2025-12-17test: use bypassPermissions mode for unrestricted testingJesse Vincent
dontAsk mode was auto-denying Write tool. Use bypassPermissions instead to allow full tool access in this controlled test environment.
2025-12-17test: auto-approve permissions with --permission-mode dontAskJesse Vincent
Headless tests need automatic permission approval to write files. Using dontAsk mode to auto-approve permissions for test directory.
2025-12-17test: add --add-dir flag for temp directory accessJesse Vincent
Claude needs explicit permission to access the temp test directory. Added --add-dir flag to grant access to the test project.
2025-12-17test: show Claude output in real-time during integration testJesse Vincent
Use tee instead of redirection so test output is visible during execution while still being saved to file for analysis.
2025-12-17fix: run integration test from superpowers dir to access local dev skillsJesse Vincent
The superpowers-dev marketplace makes skills available only when running from the plugin directory. Updated test to run claude from superpowers directory while working on the test project.
2025-12-17Fix tests to use --allowed-tools flagJesse Vincent
Claude Code headless mode requires --allowed-tools flag to actually execute tool calls. Without it, Claude only responds as if it's doing things but doesn't actually use tools. Changes: - Updated run_claude helper to accept allowed_tools parameter - Updated integration test to use --allowed-tools=all - This enables actual tool execution (Write, Task, Bash, etc.) Now the integration test should actually execute the workflow instead of just talking about it.
2025-12-17Fix syntax error in integration testJesse Vincent
Simplified command substitution to avoid shell parsing issues. Instead of nested heredoc in command substitution, write prompt to file first then read it.
2025-12-17Add integration test for subagent-driven-developmentJesse Vincent
Created full end-to-end integration test that executes a real plan and verifies the new workflow improvements actually work. New test: test-subagent-driven-development-integration.sh - Creates real Node.js test project - Generates implementation plan (2 tasks) - Executes using subagent-driven-development skill - Verifies 8 key behaviors: 1. Plan read once at beginning (not per task) 2. Full task text provided to subagents (not file reading) 3. Subagents perform self-review 4. Spec compliance review before code quality 5. Spec reviewer reads code independently 6. Working implementation produced 7. Tests pass 8. No extra features added (spec compliance) Integration tests are opt-in (--integration flag) due to 10-30 min runtime. Updated run-skill-tests.sh: - Added --integration flag - Separates fast tests from integration tests - Shows note when integration tests skipped Updated README with integration test documentation. Run with: ./run-skill-tests.sh # Fast tests only ./run-skill-tests.sh --integration # Include integration tests
2025-12-17Add Claude Code skills test frameworkJesse Vincent
Created automated test suite for testing superpowers skills using Claude Code CLI in headless mode. New files: - tests/claude-code/run-skill-tests.sh - Main test runner - tests/claude-code/test-helpers.sh - Helper functions for testing - tests/claude-code/test-subagent-driven-development.sh - First test - tests/claude-code/README.md - Documentation Test framework features: - Run Claude Code with prompts and capture output - Assertion helpers (contains, not_contains, count, order) - Test project creation helpers - Timeout support (default 5 minutes) - Verbose mode for debugging - Specific test selection First test verifies subagent-driven-development skill: - Skill loading - Workflow ordering (spec compliance before code quality) - Self-review requirements - Plan reading efficiency (read once) - Spec compliance reviewer skepticism - Review loops - Task context provision Run with: cd tests/claude-code && ./run-skill-tests.sh