Advanced Topics Preview
You have the foundation. Now see where statistics goes next — six frontiers that define modern statistical practice.
Six Frontiers
- Survival Analysis — time-to-event data
- Spatial Statistics — geographic dependence
- Functional Data — curves as observations
- High-Dimensional — p ≫ n settings
- Causal Inference — beyond correlation
- ML & Statistics — converging fields
Survival Analysis
How long until a patient dies, a machine fails, a customer churns? The key challenge: censoring — the event has not occurred yet by study end. This observation is incomplete but still informative.
Survival Curve
At each event time, multiply by the fraction still surviving. The result: a step function that drops only when events occur, ignoring the censored.
Spatial Statistics
Nearby locations are more similar than distant ones — spatial autocorrelation. Ignoring it underestimates standard errors and overstates significance.
Functional Data
Each observation is a curve, not a scalar. Growth curves, EEG traces, temperature profiles — treat the whole function as the data unit.
High-Dimensional Statistics
When p ≫ n, ordinary least squares fails completely. Regularization adds a penalty that shrinks or zeroes out coefficients.
Sparse Estimation
Minimize residual sum of squares plus an L1 penalty. The diamond-shaped constraint induces corners — solutions land exactly at zero.
Causal Inference
The fundamental problem: you can observe Y(1) or Y(0) for any unit, never both. Only the group average is estimable.
ML & Statistics
Statistics: inference, uncertainty, hypothesis testing. Machine learning: prediction, generalization, test error. They grew apart — and are now converging.
- Conformal prediction — valid intervals for any ML model
- Double ML — causal inference with high-dim controls
- Regularization — the bridge between both worlds
One Community
The most interesting work sits exactly at the intersection. Modern statisticians need ML fluency; modern ML practitioners benefit from statistical discipline.
What you previewed
Six frontiers beyond the core: survival, spatial, functional, high-dimensional, causal, and the ML intersection. Each is a discipline worth a year of study. Pick your direction.