Knowledge centerAnalysis planning

Statistical Analysis Planning

Prespecified and Exploratory Analyses Can Coexist

A credible report separates tests planned before outcome data were examined from analyses prompted by patterns found later.

Dr. Andrie Udal, PhD, MSHDSHealthcare Data Science Lead, ProWritePublished 27 July 2026Updated 27 July 2026
ProWrite editorial framework: make every critical decision explicit, reviewable, and traceable to the research record.

Exploration is not a defect in medical research. Unexpected patterns can reveal a new hypothesis, a vulnerable subgroup, a measurement problem, or a better study design. The credibility problem begins when an analysis chosen after looking at the data is described as if it had been planned in advance.

Prespecified and exploratory analyses answer different evidentiary questions. Prespecification shows which tests, variables, populations, models, and decision rules were committed to before relevant outcome patterns could influence the choice. Exploration shows what the data suggested later. Both can be useful when their status is visible.

01Prespecification requires enough detail to constrain choice

Writing “appropriate statistical tests will be used” does not prespecify an analysis. A usable statistical analysis plan should define the objective or estimand, outcome and time point, analysis population, treatment or exposure contrast, covariates, model, handling of intercurrent events and missing data, multiplicity strategy, sensitivity analyses, and presentation of estimates.

The plan should also be dated, versioned, approved, and finalized at an appropriate point before unblinded or otherwise decision-relevant outcome data are examined. The exact timing depends on study design. What matters is that the record makes clear which choices were insulated from the observed result.

SPIRIT 2025 strengthens access to protocols and statistical analysis plans, while CONSORT 2025 asks reports to identify prespecified and non-prespecified analyses. Together they support a continuous record from planning to reporting rather than a polished plan reconstructed after the fact.

02Exploration needs a traceable origin

An exploratory analysis should state what prompted it. The trigger may be a model diagnostic, an unexpected distribution, a clinically interesting pattern, a reviewer request, or a data-quality concern. Record when the idea arose, whether the relevant data had been viewed, the analysis performed, and how it changed interpretation or future work.

This context lets readers judge the result appropriately. A subgroup difference discovered after testing many possible subgroups is not equivalent to a single interaction defined in the protocol. A new cutoff selected because it creates the strongest separation is not equivalent to a threshold justified before analysis. The exploratory result may still matter, but it usually needs independent confirmation.

03Avoid the false choice between rigidity and flexibility

Teams sometimes resist prespecification because real data rarely behave exactly as expected. A good plan anticipates that reality. It can define a limited decision tree: for example, how a transformation will be selected, what happens if a model fails to converge, or which robust method will be used if assumptions are materially violated.

The plan can also distinguish a primary analysis from planned sensitivity and supportive analyses. That structure preserves flexibility without giving the analyst unlimited freedom to search for a favorable result. When an unanticipated issue genuinely requires a new method, document the deviation rather than forcing an unsuitable prespecified method or disguising the change.

04Use three labels, not one

A practical report can classify analyses as:

  • Prespecified: documented before the relevant data were examined.
  • Amended: added or changed after the original plan, with timing, rationale, data access, approval, and impact recorded.
  • Exploratory: generated to investigate an observed pattern or develop a future hypothesis.

These labels should appear in analysis outputs, not only in an appendix. Tables and figures can carry a short status note. The manuscript methods should identify the plan version, and the results and discussion should avoid confirmatory language for exploratory findings.

05Interpret according to the analytical history

A small p-value does not erase the number of choices that preceded it. The American Statistical Association warns that proper inference requires full reporting and that conclusions should not rest only on whether a p-value crosses a threshold. The analytical history—how many outcomes, subgroups, models, and cutoffs were considered—is part of the evidence.

Before submission, build a crosswalk from every reported analysis to the protocol or analysis-plan section that authorized it. If no prior specification exists, label the result amended or exploratory and explain why it was undertaken. This simple audit protects both kinds of work: planned analyses retain their confirmatory role, and discoveries remain available without being overstated.

The same labeling should follow an exploratory finding into conference abstracts, dashboards, and LinkedIn summaries. A cautious manuscript does not protect integrity if a promotional channel later presents a post hoc pattern as a confirmed clinical conclusion.

References

  1. SPIRIT 2025 Statementminimum protocol items and access to the protocol and statistical analysis plan. Accessed 27 July 2026.
  2. CONSORT 2025 Statementtransparent reporting of prespecified and non-prespecified analyses. Accessed 27 July 2026.
  3. Gamble C, et al. Guidelines for the Content of Statistical Analysis Plans in Clinical Trials. JAMA. 2017recommended SAP content and development. Accessed 27 July 2026.
  4. American Statistical Association Statement on P-Valuesfull reporting, context, and limits of threshold-based inference. Accessed 27 July 2026.

This article is educational and intended for research purposes. It does not provide individual medical advice, diagnosis, or treatment. No patient data were used.