Tools

Which Test Should I Use?

Answer a few plain-English questions about your data and design to get a recommended test and a link to the interactive lesson that teaches it. You don't need to know any jargon.

A recommendation, not a verdict. Real analyses depend on details a flowchart cannot capture. Check the test's assumptions (ANOVA & t-Test Assumptions), and remember that a significant p-value still needs an effect size next to it.

Pick one test, not many. Running several of these on the same data and keeping whichever turns up p < .05 is a quick way to get a false positive, an example of the garden of forking paths. Decide your analysis before you look at the data, ideally by preregistering it.

Planning a whole study? The Plan My Analysis wizard takes the test you reach here and builds a full, printable plan: assumptions to check, the sample size you need, and an APA write-up skeleton. Plan your analysis →

The whole map on one screen

Prefer to scan? The table below is the cheat-sheet version, and every test opens its interactive lesson. Want it on paper? Print the one-page which-test cheat sheet. Want the full explanation in prose, with advice on messy designs? Read Choosing Statistics for Your Dissertation.

Your situationTest → lessonSection
One group vs. a known valueOne-sample t-test1.13
Same people, measured twicePaired t-test1.13
Two separate groupsIndependent t-test (Welch)1.14
3+ separate groups, one factorOne-way ANOVA2.2
3+ groups, two crossed factorsFactorial ANOVA2.4
Same people, 3+ conditionsRepeated-measures ANOVA2.5
Group comparison, adjusting for a covariateANCOVA2.15
Groups compared on several outcomes at onceMANOVA3.4
Any of the above, assumptions brokenRank-based alternative2.1
Two continuous variables, associationPearson correlation1.17
Two categorical variables, associationChi-square test1.16
Predict a number, one predictorSimple linear regression1.18
Predict a number, several predictorsMultiple regression2.9
Predict yes/noLogistic regression2.16
Predict a countPoisson / negative binomial GLM3.9
Nested / clustered / repeated dataMixed (multilevel) model3.10
Time until an event, with dropoutsKaplan–Meier / survival analysis3.16
Combining many studiesMeta-analysis3.18
Causal effect, assigned by something as good as randomInstrumental variables (2SLS)3.13
Causal effect, assigned by a strict cutoff on a scoreRegression discontinuity3.14
Causal effect, a policy that arrived in some places firstDifference-in-differences3.15
Predict as accurately as possible (not test a hypothesis)Machine-learning modelsML 5.1