Episode 12 | Clustering and Classification: Finding Structure in Data

In this episode, we introduce the core ideas behind analyzing time-to-event data—situations where the outcome isn’t just “what happened,” but when it happened. A key challenge is that some participants haven’t experienced the event yet by the end of follow-up (or they drop out), so the data are only partially observed.We build the intuition for describing how risk changes over time, then walk through three practical tools: how to estimate a survival curve from one group, how to compare two groups fairly over the whole follow-up, and how to study the role of multiple predictors while keeping the time dimension front and center.

In this episode, we step into multivariate thinking and ask a practical question: when do data points naturally form “groups,” and how can we use those groups to make decisions?We walk through how grouping methods decide what’s “close” or “similar,” then compare two main approaches—building clusters step by step versus forming clusters all at once. You’ll also hear how tree-like visual summaries help us see structure in messy data, and how the same multivariate ideas can be flipped into classification, where the goal is to assign a new case to the most likely group.

This episode is about what to do when your data has many variables at once. We start with the basic idea of how variables “move together” (correlation and covariance), and why that matters for understanding patterns in real datasets.Then we introduce dimension reduction—ways to compress lots of information into a few summary features, so you can see the main structure without getting lost in details. We explain how these methods find the directions where the data varies most, and how a simple “rotation” can make the results easier to interpret.We wrap up with practical rules of thumb for deciding how many components to keep, and a quick preview of how these ideas connect to grouping similar observations and classifying new cases.

This episode is about working with categorical outcomes—questions where results fall into categories rather than a numeric scale. We learn how to check whether two variables are related, how to model the chance of a “yes/no” outcome using multiple predictors, and how to compare different modeling choices. We finish with simple ways to judge how well a model fits and whether a simpler or more detailed model is the better choice.

In this episode, we start with Fisher’s “Lady Tasting Tea”—a classic reminder that good questions need good experimental design. Then we shift from continuous outcomes to categorical data: how a simple 2×2 table turns test results into sensitivity/specificity, and study results into association measures like relative risk and odds ratios.Next, we unpack Simpson’s paradox—how the headline conclusion can flip once you stratify by a key factor. We wrap up with practical inference tools, including Fisher’s exact test and the chi-square test, plus a quick nod to ROC/AUC for evaluating classifiers.

This episode moves from one-way ANOVA to two-factor randomized experiments, focusing on how to test main effects and, more importantly, interactions—when the effect of one factor depends on the level of the other. Using examples like printer sales and a fish reproduction index, we show how ANOVA partitions variation and supports hypothesis testing. We also give a quick tour of extensions including random-effects and mixed-effects models, plus ANCOVA for adjusting with covariates. In the second half, we shift to study design in biomedicine—contrasting prospective vs. retrospective data collection—and close with a short introduction to categorical data analysis and basic concepts in clinical trials.

This episode introduces the core logic of experimental design and ANOVA: what we mean by causality, factors, and confounders—and why randomization, replication, and blocking are the practical tools that make comparisons fair. We build the one-way ANOVA model, run the hypothesis test in R, and discuss multiple comparisons and how to control Type I error. We also connect ANOVA to regression, highlight R.A. Fisher’s role in modern statistics, and close with randomized block designs to improve precision by accounting for nuisance variation.

Episode 6 is about making multiple regression work in real life: how to choose predictors without overfitting, when to transform variables to fix messy variance or nonlinearity, and what to do when predictors are strongly correlated. We’ll walk through tools like Mallows’ Cp, partial F tests, and stepwise selection, then wrap up with ridge and lasso as practical fixes for multicollinearity—with quick examples along the way.

Episode 5 connects the “big picture” of multiple linear regression: the matrix form of the model, how least squares and maximum likelihood lead to the same estimates under standard assumptions, and what the ANOVA table is really decomposing. We compare r-square vs. adjusted r-square, review t-tests for individual predictors and the F-test for overall model validity, and finish with practical model selection (AIC and partial F-tests) plus examples on diagnosing outliers and interpreting results.

Episode 4 introduces multiple linear regression—how to model an outcome using several predictors at once, and how to interpret each effect while holding the others constant.We cover dummy variables for categorical data, and interaction terms (e.g., how experience and gender together can change salary patterns). We also compare regression with the two-sample mean test, showing how they’re related but regression is more flexible. We end with a practical note: p-values aren’t the whole story, and conclusions should rely on context and assumptions, with nonparametric options available when data don’t fit normality well.