Section 23Experimentation and Evidence
Reliability and recovery requirements
Defines failure isolation, cancellation, crash recovery, artifact safety, checkpoint handling, and actionable failure reporting.
Section relationships
| ID | Name | Priority | Requirement | Verification |
|---|---|---|---|---|
| REL-001 | Structured failure | MVP | Every anticipated compile, load, run, save, controller, and backend failure SHALL produce a structured error and preserve prior valid project state. | Test |
| REL-002 | No false completion | MVP | A failed, cancelled, or interrupted run SHALL never be marked complete. | Test |
| REL-003 | Endurance | MVP | The reference scenario SHALL complete TBD-REL-ENDURANCE without crash, invalid state, or unbounded memory growth. | Analysis |
| REL-004 | Repeatable reset | MVP | Repeated reset and rerun cycles SHALL satisfy the selected reproducibility criterion without cumulative state leakage. | Test |
| REL-005 | Corrupt-input handling | MVP | Corrupt, truncated, oversized, cyclic, or unsupported project and asset inputs SHALL fail with bounded resource use and actionable diagnostics. | Test |
| REL-006 | Save interruption recovery | MVP | An interrupted save SHALL leave either the previous valid project or the new valid project recoverable. | Test |
| REL-007 | Cache invalidation | MVP | A compiled or asset cache SHALL not be reused when an identity-bearing input, version, capability, or option changes. | Test |
| REL-008 | Checkpoint compatibility | Beta | A checkpoint SHALL declare its compatible software, schema, and backend versions and SHALL fail safely when incompatible. | Test |
| REL-009 | Adapter restart policy | Beta | A process adapter SHALL declare whether restart and state recovery are supported; BeforeMetal SHALL not assume transparent recovery. | Test |
| REL-010 | Resource exhaustion | Beta | Resource exhaustion SHALL terminate or degrade work according to a named policy without corrupting completed artifacts. | Test |
| REL-011 | Warning escalation | MVP | An experiment SHALL be able to treat selected warning codes as compile or run errors. | Test |
| REL-012 | Issue reproduction report | Beta | BeforeMetal SHALL create a redacted diagnostic report containing versions, manifest identity, logs, warnings, and reproduction instructions. | Demonstration |
Generated from the canonical specification. Edit section metadata or prose in docs/requirements.md; the website rebuilds this page and its relationships automatically.