Document Type: Canon
Status: Canon
Version: v0.2
Authority: MWMS HeadOffice
Applies To: SITengine v0.1 Manual Runs
Parent: SIT Brain Canon
Last Reviewed: 2026-03-15
Purpose
This document defines the exact verification checks performed by SITengine v0.1.
It defines what constitutes PASS and FAIL.
No interpretation is permitted.
Scope
This canon applies to:
• SITengine v0.1 manual-run verification checks
• system health checks used by SITengine
• end-to-end smoke-test logic
• PASS / FAIL determination rules
• timeout behaviour
• minimum logging requirements for SIT test execution
This document governs the test logic used by SITengine v0.1.
It does not govern:
• automatic output blocking
• severity classification beyond PASS / FAIL
• compliance interpretation
• optimisation advice
• broader SIT dashboard behaviour
• future SIT versions beyond v0.1
Those remain governed by SIT Brain Canon, SIT Engine – Minimal Design Specification, SIT Log Schema, and later approved SIT versions.
Definition / Rules
Test Categories (v0.1)
SITengine v0.1 performs two categories of checks.
A. System Health Checks
• Supabase reachable
• tasks table readable
• tasks table writable
• executor reachable, indirect via task state change
If any health check fails, overall result = FAIL.
B. End-to-End Task Smoke Test
SITengine creates one task with:
• kind: sit_test_v0_1
• status: initial queue state, for example pending
• payload_json: contains test marker
The system must:
• detect the task
• process the task
• change status away from initial state
• conclude in either complete or failed
Rules:
• if final status = complete → PASS for this step
• if final status = failed → FAIL
• if task remains in initial state beyond timeout → FAIL
Timeout Rules
Default timeout window: 60 seconds
Polling interval: system-defined, implementation detail
If no state transition occurs within timeout, result = FAIL.
PASS Rule
Overall PASS occurs only if:
• all health checks pass
• smoke test completes successfully
• log record successfully written
If any component fails, overall FAIL.
Logging Requirement
Each run must produce:
• timestamp
• run_id
• overall_result (PASS / FAIL)
• failed_step (if any)
• task_id (if created)
Logs must be immutable.
Non-Goals
SIT Test Suite v0.1 does not:
• auto-block system outputs
• classify severity levels
• perform bias analysis
• enforce compliance interpretation
• provide optimisation advice
It only verifies system integrity.
Operational Test Discipline
This suite exists to answer one bounded verification question through fixed checks.
It must not drift into:
• diagnosis essays
• business commentary
• risk interpretation
• execution guidance
The suite is mechanical by design.
Drift Protection
The system must prevent:
• additional checks being silently added to v0.1
• PASS being returned when the log write fails
• health-check success being mistaken for end-to-end success
• smoke-test timeouts being ignored or softened
• interpretation layers being added on top of fixed PASS / FAIL logic
• v0.1 test logic drifting into advisory behaviour
SIT Test Suite v0.1 must remain narrow, fixed, and mechanically verifiable.
Architectural Intent
SIT Test Suite exists to lock the exact checks used by SITengine so verification remains stable, repeatable, and non-interpretive.
Its role is to ensure that manual SIT runs test the same core pipeline conditions each time and that PASS or FAIL reflects actual end-to-end operability rather than subjective judgement.
Final Rule
SITengine v0.1 answers only one question:
“Is the system operational end-to-end right now?”
Nothing more.
Change Log
Version: v0.2
Date: 2026-03-15
Author: MWMS HeadOffice
Change: Rebuilt page to align with the locked MWMS document standard for this cleanup pass. Preserved the original purpose, two test categories, smoke-test rules, timeout rules, PASS rule, logging requirement, non-goals, and final-rule intent. Added Document Type, Parent, Purpose / Scope / Definition / Rules structure, Operational Test Discipline, Drift Protection, Architectural Intent, and updated the review date.
Version: v0.1
Date: 2026-02-13
Author: MWMS HeadOffice
Change: Initial creation of SIT Test Suite defining the exact verification checks performed by SITengine v0.1.
END – SIT TEST SUITE v0.2