Tool

Which test? The test chooser

The decision tree: every question, every answer, every test
The decision tree: every question, every answer, every test What kind of outcome did you measure? Two numbers on the same units: do they move together? Is the relationship roughly a straight line, without strong outliers? Yes: roughly a straight line The test: Pearson correlation test. Yes No One group A difference Equivalent Independent Paired Two Three or more A number One group Two independent Same cases twice Three or more Yes / no A planned mix Another category A category Events per exposure Yes No Two numbers One group Two or more A spread z test one-sample t σ known? Welch t TOST Show what? paired t Paired? ANOVA + Tukey Groups? one proportion two proportions McNemar χ² (groups) Groups? χ² goodness of fit χ² independence Against? rate ratio Pearson r Spearman ρ Straight line? χ² variance Levene Groups? Outcome?

Questions run from left to right; the path lights up as you answer, and each leaf on the right is a test. On a phone, the tree scrolls sideways in its box.

The questions

  1. What kind of outcome did you measure? Two numbers on the same units: do they move together?

  2. Is the relationship roughly a straight line, without strong outliers? Yes: roughly a straight line

The test

Pearson correlation test

Assumes
A straight-line relationship; roughly normal; no strong outliers.
How to check
A scatter plot: always plot it.
If it fails
Spearman's rank correlation.
Python (scipy, statsmodels)
pearsonr(x, y)
Excel
=T.DIST.2T(ABS(r*SQRT(n-2)/SQRT(1-r^2)), n-2)

Which test fits depends on what you measured, how many groups you compare, whether the groups are independent or paired, and whether σ is known. Answer one question at a time: the path lights up in the tree, and the leaf names the test with its assumptions, what to do if they fail, and the code. Or switch to the drill and name the test for a scenario yourself.

An unhandled error has occurred. Reload ๐Ÿ—™

Reconnecting…

Your connection to Hypothesis Testing Lab dropped, probably a Wi-Fi blip. Hold on while it reconnects.

The connection could not be restored. The page will reload in a few seconds.