Summary by TwinMind · 11m 37s
Summary by TwinMind · 11m 37s
Using Linear Models for t tests and ANOVA, Clearly Explained!!!
Using Linear Models for t tests and ANOVA, Clearly Explained!!!
StatQuest with Josh Starmer
StatQuest with Josh Starmer
Introduction and Series Context
- Part 2 of General Linear Models series from StatQuest
- Presented by genetics department at University of North Carolina at Chapel Hill
- Previous episode covered linear regression, this episode extends same techniques to t-tests and ANOVA
- Uses design matrix concept for unified approach
Linear Regression Review
- Previous example: mouse weight vs mouse size analysis
- Two key questions answered:
- How useful is mouse weight for predicting size (r-squared)
- Is relationship due to chance (p-value)
- Goal: apply same concepts to t-tests
T-Test Application Setup
- Example: gene expression comparison between control mice and mutant mice
- Mutant mice = normal mice with specific gene knocked out/non-functioning
- T-test goal: compare means and determine if significantly different
- Same method for calculating p-values enables handling more complex situations
Step-by-Step T-Test Process Using Linear Regression Framework
Step 1: Find Overall Mean
- Ignore x-axis initially, focus on y-axis
- Calculate overall mean for both linear regression and t-test cases
- X-axis labels removed to emphasize y-axis focus
Step 2: Calculate Sum of Squared Residuals Around Mean (SS_mean)
- Calculate residuals (distance from data points to overall mean line)
- Square and sum these residuals
- Same process for both regression and t-test
Step 3: Fit Lines to Data
- Linear regression: single least squares fit line
- T-test approach:
- Fit separate lines to control and mutant data
- Control data: mean = 2.2, equation y = 2.2 (horizontal line)
- Mutant data: mean = 3.6, equation y = 3.6 (horizontal line)
- Two separate horizontal lines (means are least squares fits)
Step 4: Combine Lines Using Design Matrix
- Challenge: combine two separate lines into single equation for computer automation
- Unified equation format: y = (coefficient₁ × control_mean) + (coefficient₂ × mutant_mean) + residual
- Control points: coefficient₁ = 1, coefficient₂ = 0
- Mutant points: coefficient₁ = 0, coefficient₂ = 1
- Coefficients act as on/off switches for respective means
Design Matrix Structure
- Matrix of 1s and 0s isolated from equations
- Column 1: controls control mean (on/off)
- Column 2: controls mutant mean (on/off)
- Combined with abstract equation: y = control_mean + mutant_mean
- Enables single equation representation of fit
Step 5: Calculate Sum of Squares Around Fitted Lines
- Linear regression: sum of squared residuals around fitted line
- T-test: sum of squared residuals around fitted means (horizontal lines)
Step 6: Calculate F-statistic and P-value
- Use same F equation for both regression and t-test
- Parameters:
- p_mean = 1 (single parameter for overall mean in both cases)
- p_fit for regression = 2 (intercept + slope)
- p_fit for t-test = 2 (control mean + mutant mean)
- F-statistic leads to p-value calculation
ANOVA Extension
- Tests if all categories have same mean
- Example: 5 categories total
- Control mice
- Mutant mice
- Control mice on funky diet
- Mutant mice on funky diet
- Heterozygous mice
ANOVA Process
- Step 1: Calculate sum of squares around overall mean (same as before)
- Overall mean equation: y = mean_expression
- p_mean = 1 (single parameter)
- Step 2: Calculate sum of squares around fitted lines
- Equation has 5 parameters (one mean per category)
- p_fit = 5
- Design matrix: one column per category (5 columns total)
- Calculate F-statistic and p-value using same framework
Design Matrix Variations
- StatQuest used specific design matrix format
- More common alternative design matrix exists for same t-test
- Both matrices achieve same results
- Standard matrices will be covered in next episode
- Future episodes will cover more elaborate designs
