Result Interpretation

Result interpretation compares what happened with what was predicted before the run. A result is not just a number; it is evidence for or against a hypothesis under a stated protocol.

When a result is used publicly, summarize the supported statement with a Claim evidence record.

The basic comparison is:

Outcomes

  • Confirmed: the result meets the pre-registered success threshold.
  • Not confirmed: the result does not meet the threshold.
  • Surprising: the direction, size, or failure mode differs from prediction.
  • Inconclusive: the run failed, variance is too large, or the protocol is flawed.

Checks

  • Was the metric computed on the intended split?
  • Did any data, code, or environment drift occur?
  • Is the effect larger than run-to-run variance?
  • Does the result beat the baseline that matters?
  • Is the conclusion limited to the tested setting?
  • What should be updated: hypothesis, data, model, metric, or workflow?