Independent Replication
Minimum replication set
An independent replication must run at least:
- T0 uncontrolled baseline;
- T2 conventional-security baseline;
- T4 full AI SAFE² treatment;
- one legitimate collaboration scenario;
- one control-plane failure scenario.
Requirements
- Start from a clean environment.
- Use published manifests, policies, fixtures, graders, and analysis.
- Record unavoidable model or platform substitutions.
- Do not receive unpublished success criteria or manual corrections from the original team.
- Publish all exclusions, failed runs, and deviations.
- Report raw counts, confidence intervals, utility measures, and evidence-verification results.
Replication outcome
Independent replication does not require identical point estimates. It requires consistent material direction, no contradiction of catastrophic claims, and evidence sufficient to explain important differences.
Claims that have not been independently reproduced must remain below C5.