AX Engineering Console

skill / test

Test

Experimental

Run the quality gates a project actually declared and report their real results, keeping passed, failed, unavailable, and unrun distinct.

Prerequisites

  • A resolved project declaration, so every enabled gate has a command.
  • A working tree in the state that is meant to be tested.

Steps

  1. Read the resolved commands rather than inventing one.
  2. Run each enabled gate in the declared order.
  3. Record the exit status and the relevant output for each gate.
  4. Report a gate with no command as unavailable, never as passed.
  5. Report a gate that was not run as unrun, never as passed.
  6. Summarize which gates ran, which failed, and what the failure was.

Capabilities needed

  • read_code
  • run_tests

Outputs

  • A per-gate result of passed, failed, unavailable, or unrun.
  • The evidence behind each result.

Verification

  • Every reported result corresponds to a command that actually ran.
  • No gate is marked passed because it was skipped, disabled, or substituted.

Escalates when

  • A declared command does not exist; report it unavailable rather than substituting another.
  • A gate needs credentials, a database, or a network service that policy denies.
skill / test
{
  "schemaVersion": 1,
  "id": "test",
  "name": "Test",
  "status": "experimental",
  "purpose": "Run the quality gates a project actually declared and report their real results, keeping passed, failed, unavailable, and unrun distinct.",
  "prerequisites": [
    "A resolved project declaration, so every enabled gate has a command.",
    "A working tree in the state that is meant to be tested."
  ],
  "steps": [
    "Read the resolved commands rather than inventing one.",
    "Run each enabled gate in the declared order.",
    "Record the exit status and the relevant output for each gate.",
    "Report a gate with no command as unavailable, never as passed.",
    "Report a gate that was not run as unrun, never as passed.",
    "Summarize which gates ran, which failed, and what the failure was."
  ],
  "capabilities": [
    "read_code",
    "run_tests"
  ],
  "outputs": [
    "A per-gate result of passed, failed, unavailable, or unrun.",
    "The evidence behind each result."
  ],
  "verification": [
    "Every reported result corresponds to a command that actually ran.",
    "No gate is marked passed because it was skipped, disabled, or substituted."
  ],
  "escalation": [
    "A declared command does not exist; report it unavailable rather than substituting another.",
    "A gate needs credentials, a database, or a network service that policy denies."
  ]
}

Rendered from the loaded definition rather than read from disk, so there is no file path for a request to influence.