gh-joshuaoliphant-claude-plugins-plugins-adw-bootstrap/skills/adw-bootstrap/reference/scaled/commands/test.md

Application Validation Test Suite

Execute comprehensive validation tests for both frontend and backend components, returning results in a standardized JSON format for automated processing.

Purpose

Proactively identify and fix issues in the application before they impact users or developers. By running this comprehensive test suite, you can:

• Detect syntax errors, type mismatches, and import failures
• Identify broken tests or security vulnerabilities
• Verify build processes and dependencies
• Ensure the application is in a healthy state

Variables

TEST_COMMAND_TIMEOUT: 5 minutes

Instructions

• Execute each test in the sequence provided below
• Capture the result (passed/failed) and any error messages
• IMPORTANT: Return ONLY the JSON array with test results
  • IMPORTANT: Do not include any additional text, explanations, or markdown formatting
  • We'll immediately run JSON.parse() on the output, so make sure it's valid JSON
• If a test passes, omit the error field
• If a test fails, include the error message in the error field
• Execute all tests even if some fail
• Error Handling:
  • If a command returns non-zero exit code, mark as failed and immediately stop processing tests
  • Capture stderr output for error field
  • Timeout commands after TEST_COMMAND_TIMEOUT
  • IMPORTANT: If a test fails, stop processing tests and return the results thus far
• Some tests may have dependencies (e.g., server must be stopped for port availability)
• API health check is required
• Test execution order is important - dependencies should be validated first
• All file paths are relative to the project root
• Always run pwd and cd before each test to ensure you're operating in the correct directory for the given test

Test Execution Sequence

Backend Tests

1. Python Syntax Check

   • Preparation Command: None
   • Command: cd app/server && uv run python -m py_compile server.py main.py core/*.py
   • test_name: "python_syntax_check"
   • test_purpose: "Validates Python syntax by compiling source files to bytecode, catching syntax errors like missing colons, invalid indentation, or malformed statements"

2. Backend Code Quality Check

   • Preparation Command: None
   • Command: cd app/server && uv run ruff check .
   • test_name: "backend_linting"
   • test_purpose: "Validates Python code quality, identifies unused imports, style violations, and potential bugs"

3. All Backend Tests

   • Preparation Command: None
   • Command: cd app/server && uv run pytest tests/ -v --tb=short
   • test_name: "all_backend_tests"
   • test_purpose: "Validates all backend functionality including file processing, SQL security, LLM integration, and API endpoints"

Frontend Tests

4. TypeScript Type Check

   • Preparation Command: None
   • Command: cd app/client && bun tsc --noEmit
   • test_name: "typescript_check"
   • test_purpose: "Validates TypeScript type correctness without generating output files, catching type errors, missing imports, and incorrect function signatures"

5. Frontend Build

   • Preparation Command: None
   • Command: cd app/client && bun run build
   • test_name: "frontend_build"
   • test_purpose: "Validates the complete frontend build process including bundling, asset optimization, and production compilation"

Report

• IMPORTANT: Return results exclusively as a JSON array based on the Output Structure section below.
• Sort the JSON array with failed tests (passed: false) at the top
• Include all tests in the output, both passed and failed
• The execution_command field should contain the exact command that can be run to reproduce the test
• This allows subsequent agents to quickly identify and resolve errors

Output Structure

[
  {
    "test_name": "string",
    "passed": boolean,
    "execution_command": "string",
    "test_purpose": "string",
    "error": "optional string"
  },
  ...
]

Example Output

[
  {
    "test_name": "frontend_build",
    "passed": false,
    "execution_command": "cd app/client && bun run build",
    "test_purpose": "Validates TypeScript compilation, module resolution, and production build process for the frontend application",
    "error": "TS2345: Argument of type 'string' is not assignable to parameter of type 'number'"
  },
  {
    "test_name": "all_backend_tests",
    "passed": true,
    "execution_command": "cd app/server && uv run pytest tests/ -v --tb=short",
    "test_purpose": "Validates all backend functionality including file processing, SQL security, LLM integration, and API endpoints"
  }
]