AX Engineering Console

pipeline / default

Quality pipeline

No status

Ordered quality pipeline. Cheap and broad checks run first so that an expensive stage is only reached once the earlier ones have passed.

Stages, in order

  1. Build (executable) — The project compiles or packages. Nothing later is meaningful if this fails.
  2. Lint (executable) — Style and correctness rules the project has chosen to enforce.
  3. Typecheck (executable) — Static types agree across the change.
  4. Unit tests (executable) — Fast tests that do not need external services.
  5. Integration tests (executable) — Tests that exercise real collaborators, and may need a database or network.
  6. Security (executable) — Automated dependency and configuration checks. Not a substitute for security review.
  7. Independent review (human) — A reviewer who did not write the change assesses it. Cannot be disabled.
  8. Agent evaluation (eval) — Assesses how the agent worked, which application tests cannot measure.
  9. Human approval (human) — A person accepts the change. Cannot be disabled.
pipeline / default
{
  "schemaVersion": 1,
  "id": "default",
  "description": "Ordered quality pipeline. Cheap and broad checks run first so that an expensive stage is only reached once the earlier ones have passed.",
  "stages": [
    {
      "id": "build",
      "title": "Build",
      "kind": "executable",
      "quality": "build",
      "command": "build",
      "description": "The project compiles or packages. Nothing later is meaningful if this fails."
    },
    {
      "id": "lint",
      "title": "Lint",
      "kind": "executable",
      "quality": "lint",
      "command": "lint",
      "description": "Style and correctness rules the project has chosen to enforce."
    },
    {
      "id": "typecheck",
      "title": "Typecheck",
      "kind": "executable",
      "quality": "typecheck",
      "command": "typecheck",
      "description": "Static types agree across the change."
    },
    {
      "id": "unit_tests",
      "title": "Unit tests",
      "kind": "executable",
      "quality": "tests",
      "command": "test",
      "description": "Fast tests that do not need external services."
    },
    {
      "id": "integration_tests",
      "title": "Integration tests",
      "kind": "executable",
      "quality": "integration_tests",
      "command": "integration_test",
      "description": "Tests that exercise real collaborators, and may need a database or network."
    },
    {
      "id": "security",
      "title": "Security",
      "kind": "executable",
      "quality": "security",
      "command": "security",
      "description": "Automated dependency and configuration checks. Not a substitute for security review."
    },
    {
      "id": "review",
      "title": "Independent review",
      "kind": "human",
      "quality": "review",
      "description": "A reviewer who did not write the change assesses it. Cannot be disabled."
    },
    {
      "id": "eval",
      "title": "Agent evaluation",
      "kind": "eval",
      "quality": "eval",
      "description": "Assesses how the agent worked, which application tests cannot measure."
    },
    {
      "id": "human_approval",
      "title": "Human approval",
      "kind": "human",
      "quality": "human_approval",
      "description": "A person accepts the change. Cannot be disabled."
    }
  ]
}

Rendered from the loaded definition rather than read from disk, so there is no file path for a request to influence.