PhD / Research · Biostatistics and Data Science

Multiple testing

Read the topic background here, then explore the labeled visual and structured learning explanations on this page.

Read explanation on this page ↓ See diagram ↓
Read here · Related subject background

Multiple comparisons problem — on-site reading

This reference extract addresses Multiple comparisons problem, a related subject. It does not cover every part of Multiple testing.. The article introduction is reproduced here, so you do not need to leave MedAtlas to read it. It may not match the latest official medical guidance.

Multiple comparisons, multiplicity or multiple testing problem occurs when many statistical tests are performed on the same dataset. Each test has its own chance of a Type I error (false positive), so the overall probability of making at least one false positive increases as the number of tests grows. In statistics, this occurs when one simultaneously considers a set of statistical inferences or estimates a subset of selected parameters based on observed values.
The probability of false positives is measured through the family-wise error rate (FWER). The larger the number of inferences made in a series of tests, the more likely erroneous inferences become. Several statistical techniques have been developed to compensate for the number of inferences being made—for example, by requiring a stricter significance threshold for individual comparisons.

How this connects to Biostatistics and Data Science

Statistical inference links sample measurements to estimates under explicit assumptions. Effect size, precision, confounding, missing data and model validation matter more than a single threshold. Reproducibility requires documenting data transformations, analysis code and justified decision rules.

Text credit: Wikipedia contributors, “Multiple comparisons problem”, original article · authors & revision history · CC BY-SA 4.0. Unmodified opening extract, accessed 24 September 2026. This Wikipedia-derived section is provided under CC BY-SA 4.0; the independent MedAtlas notes and design are separate works.

On-site diagram

Multiple testing · visual study map

Scalable vector illustration. Labeled conceptual map, not a precise anatomical, histological or diagnostic image.
TOPIC LEARNING MAP · NOT AN ANATOMICAL PLATE01 · BackgroundMultiple comparisons, multiplicity ormultiple testing problem occurs whenmany statistical tests are…02 · Main conceptEach test has its own chance of a Type Ierror (false positive), so the overallprobability of making at…03 · Related processIn statistics, this occurs when onesimultaneously considers a set ofstatistical inferences or estimates a…04 · Study connectionThe probability of false positives ismeasured through the family-wise errorrate (FWER).Multiple testingRead the full text below the visual · all reading is on this website

The wording in this learning map is adapted from the attributed Wikipedia background section below (CC BY-SA 4.0).

Study foundation 01

What the underlying subject studies

Biomedical research begins with a focused, ethically valid question. Define the study population, variables, measurements and decision-relevant uncertainty before selecting a method.

Study foundation 02

How mechanisms and evidence connect

Compare alternative study designs and account for sampling, confounding, bias, imprecision, missing data and the limits of causal inference. Sound statistical analysis cannot repair invalid measurements or unethical recruitment.

Study foundation 03

How to develop a sound explanation

Doctoral-level mastery involves reading primary methods, reproducing calculations, writing transparent protocols and defending the assumptions behind each conclusion. University-specific courses and laboratory competencies differ.

References and verification (optional)

All reading material on this page appears above. The links below are for checking the primary syllabus, research or source attribution, not requirements for opening this lesson.

PubMed ↗

Find research on Multiple testing ↗