---
{
  "id": "ASD-EXP-TESTS-REPRODUCIBILITY-EN",
  "path": "/en/tests/reproducibility",
  "title": "Reproducibility for Experimental Predictions",
  "title_en": "Reproducibility for Experimental Predictions",
  "category": "Experimental Program",
  "summary": "Make sources, equations, inputs, code, environment, expected outputs and failure criteria standard deliverables for every prediction.",
  "template": "test",
  "version": "1.0.0",
  "updated": "2026-09-22",
  "date_published": "2026-09-22",
  "canonical": false,
  "source_tier": "published",
  "theory_status": "OPEN",
  "evidence_status": "UNTESTED",
  "locale": "en",
  "module_key": "experimental-program",
  "module_navigation": [
    {
      "path": "/en/tests",
      "label": "Program",
      "en": "Program"
    },
    {
      "path": "/en/tests/predictions",
      "label": "Registry",
      "en": "Registry"
    },
    {
      "path": "/en/tests/falsification",
      "label": "Falsification",
      "en": "Falsification"
    },
    {
      "path": "/en/tests/priority-experiments",
      "label": "Priorities",
      "en": "Priorities"
    },
    {
      "path": "/en/tests/reproducibility",
      "label": "Reproducibility",
      "en": "Reproducibility"
    }
  ],
  "canonical_scope": "Experimental program; not a new canonical physical result",
  "source_chapter": "Existing canonical module snapshots / 现有正式模块快照",
  "source_reference": "Predictions & Falsification v1.0 · review 2026-09-22",
  "source_version": "EXP-7ca61744dcd2",
  "source_sha256": "7ca61744dcd2129e7fcd6902223c71166f3ededeb84b599d544cb20dba88130a",
  "source_kind": "manifest",
  "source_manifest": "predictions-source-manifest.json",
  "source_manifest_url": "/downloads/ASD_Predictions_Source_Manifest.json",
  "last_reviewed": "2026-09-22",
  "depends_on": [],
  "related": [
    "/en/tests",
    "/en/tests/predictions",
    "/en/tests/falsification",
    "/en/tests/priority-experiments"
  ],
  "open_problems": [],
  "equations": [],
  "sources": [
    {
      "label": "Predictions source and scope manifest",
      "kind": "research-program",
      "url": "/downloads/ASD_Predictions_Source_Manifest.json"
    },
    {
      "label": "Ota et al. (2022), Nature Physics 18, 1436–1440",
      "url": "https://www.nature.com/articles/s41567-022-01767-w",
      "kind": "external-reference"
    },
    {
      "label": "PDG (2024), Cosmic Rays review",
      "url": "https://pdg.lbl.gov/2024/reviews/rpp2024-rev-cosmic-rays.pdf",
      "kind": "external-reference"
    },
    {
      "label": "Wolf et al. (2006), Cold Atom Clock Test of Lorentz Invariance in the Matter Sector",
      "url": "https://arxiv.org/abs/hep-ph/0601024",
      "kind": "external-reference"
    },
    {
      "label": "BACON Collaboration (2021), optical frequency ratio network",
      "url": "https://www.nist.gov/publications/frequency-ratio-measurements-18-digit-accuracy-using-network-optical-clocks",
      "kind": "external-reference"
    }
  ],
  "outline": [
    "Reproduction is more than drawing a curve",
    "Minimum reproducible record",
    "Frozen parameters and fair comparisons",
    "Scope of this release"
  ],
  "seo_title": "Reproducibility for Experimental Predictions | ASD Predictions & Falsification v1.0",
  "canonical_url": "https://asd-physics.org/en/tests/reproducibility",
  "translation_path": "/tests/reproducibility",
  "mathematical_review": "INCOMPLETE",
  "evidence_note": "No closed quantitative discriminator; planning/comparison only.",
  "translation_of": "/tests/reproducibility",
  "translation_version": "1.0.0"
}
---
## Reproduction is more than drawing a curve

<ProgramNavigation />

Raw-data reproduction, comparison-model recalculation, an independent ASD prediction and an apparatus fit are different outputs. Label every run. Synthetic data cannot enter an observational-support column.

## Minimum reproducible record

| File / record | Required content |
| --- | --- |
| README | Prediction ID, scope, commands, limits and expected result |
| equations.md | Equation IDs, source versions, inputs and approximations |
| input / provenance | Source, license, units, selection, raw/processed/synthetic labels |
| notebook + script | Common-input interfaces for both models; missing ASD output explicit |
| expected output + figure | Checkable values and figures, without presenting examples as experiments |
| environment | Python/software versions, dependencies and seeds if used |
| checksums | SHA-256 of inputs, code and expected outputs |
| decision protocol | Error budget, correlations, likelihood, rejection region and affected node |

[Download the runnable kit](/downloads/ASD_Experimental_Reproducibility_Kit.zip) · [Documentation and commands](/en/research/reproducibility)

## Frozen parameters and fair comparisons

Record which parameters come from independent measurements and which are fitted here. Separate calibration and test data. Both models use the same apparatus, selection and noise assumptions. If calibration depends on theory, model that explicitly instead of silently sharing a theory-reconstructed “raw field.” Retain failures, zero differences and non-identifiability.

## Scope of this release

The kit recalculates directional geometry, constant-energy standard muon survival, binned acceptance sums and a standard point-charge waveform through an assumed response. It supplies no novel ASD prediction, real-data fit or completed Ota/S301 reproduction. A formal data release is a separate later version.
