Tool

Which test? The test chooser

The decision tree: every question, every answer, every test
The decision tree: every question, every answer, every test What kind of outcome did you measure? Yes or no for each unit: converted, on time, correct How many groups, and how were they scored? Two independent groups The test: Two-proportion z test. Yes No One group A difference Equivalent Independent Paired Two Three or more A number One group Two independent Same cases twice Three or more Yes / no A planned mix Another category A category Events per exposure Yes No Two numbers One group Two or more A spread z test one-sample t σ known? Welch t TOST Show what? paired t Paired? ANOVA + Tukey Groups? one proportion two proportions McNemar χ² (groups) Groups? χ² goodness of fit χ² independence Against? rate ratio Pearson r Spearman ρ Straight line? χ² variance Levene Groups? Outcome?

Questions run from left to right; the path lights up as you answer, and each leaf on the right is a test. On a phone, the tree scrolls sideways in its box.

The questions

  1. What kind of outcome did you measure? Yes or no for each unit: converted, on time, correct

  2. How many groups, and how were they scored? Two independent groups

The test

Two-proportion z test

Assumes
Independent units; at least 10 successes and 10 failures in each group.
How to check
Count them in each group.
If it fails
Fisher's exact test.
Python (scipy, statsmodels)
proportions_ztest([k1, k2], [n1, n2])
Excel
=2*(1-NORM.S.DIST(ABS(z), TRUE))

Which test fits depends on what you measured, how many groups you compare, whether the groups are independent or paired, and whether σ is known. Answer one question at a time: the path lights up in the tree, and the leaf names the test with its assumptions, what to do if they fail, and the code. Or switch to the drill and name the test for a scenario yourself.

An unhandled error has occurred. Reload ๐Ÿ—™

Reconnecting…

Your connection to Hypothesis Testing Lab dropped, probably a Wi-Fi blip. Hold on while it reconnects.

The connection could not be restored. The page will reload in a few seconds.