Common Statistical Tests
You know the logic. Now meet the toolkit. Seven tests that cover most real-world hypothesis testing scenarios — from comparing a single mean to finding associations in categorical data.
Z-Test for Means
Use when σ is known (rare in practice). Critical values: ±1.96 for α = 0.05 two-tailed.
One-Sample t-Test
s = sample SD, df = n − 1. The t-distribution has heavier tails than Z — extra uncertainty from estimating σ. As n → ∞, t → Z.
Two-Sample t-Test
df = n₁ + n₂ − 2. H₀: μ₁ = μ₂. Prefer Welch’s t-test when variances may differ — it’s safer and nearly as powerful when they’re equal.
Paired t-Test
d̄ = mean of differences, df = n − 1 pairs. More powerful than two-sample t when pairs are strongly correlated — eliminates between-subject noise.
One-Proportion Z-Test
p̂ = sample proportion. Valid when np₀ ≥ 10 and n(1−p₀) ≥ 10.
Two-Proportion Z-Test
p̄ = pooled proportion. The backbone of A/B testing in industry — comparing conversion rates, click-through rates, etc.
Chi-Squared Test
O = observed, E = expected under independence. df = (r−1)(c−1). Requires E ≥ 5 in every cell.
Effect Size
|d| ≈ 0.5 medium
|d| ≈ 0.8 large
OR > 1 → higher odds
OR < 1 → lower odds
A tiny p-value doesn’t mean a big effect. Always report both.
Which Test?
- One mean, σ known → Z-test
- One mean, σ unknown → one-sample t
- Two independent means → Welch’s t
- Matched/before-after → paired t
- One proportion → proportion Z
- Two proportions → two-prop Z
- Categorical association → chi-squared
What you learned
- Z-test: use only when σ is known; ±1.96 critical values
- t-tests: one-sample, two-sample (Welch), paired — match to your data structure
- Proportion Z-tests: for binary outcomes, one or two groups
- Chi-squared: independence between two categorical variables
- Effect size (Cohen’s d, OR) completes the picture p-values can’t alone