AI summary by TwinMind

A Gentle Introduction to Machine Learning

StatQuest with Josh Starmer

12m 45s

Introduction and Context

  • Josh Stormer presenting Stack Quest episode
  • Originally prepared for Society for Scientific Advancements (SOSA) annual conference
  • SOSA promotes science and technology in Jamaica
  • Focus: gentle introduction to machine learning concepts

Decision Tree Example - Stack Quest Preference Prediction

  • Silly example to illustrate decision tree concept
  • Decision tree classifies people as loving Stack Quest or not
  • Logic flow:
    • If like silly songs → check machine learning interest
      • If like ML → will love Stack Quest
      • If not like ML → check statistics interest
        • If like statistics → will love Stack Quest
        • If not → might not like Stack Quest
    • If don't like silly songs → check machine learning interest
      • If like ML → will love Stack Quest
      • If not like ML → check statistics interest
        • If like statistics → will love Stack Quest
        • If not → might not like Stack Quest
  • Decision trees are machine learning method for prediction/classification

Linear Regression Example - Running Speed vs Yam Consumption

  • Hypothetical data: 100-meter dash speed vs yam consumption
  • Examples: Josh (slow, little yam), Usain Bolt (fast, lots of yam)
  • Black line fitted to show trend: more yam = faster running
  • Line used for predictions based on yam consumption input
  • Demonstrates machine learning as prediction tool

Core Machine Learning Concepts

Training Data vs Testing Data

  • Original data = training data
  • Black line fitted to training data
  • Green squiggle also fitted to training data (better fit)
  • Blue dots = testing data (new people measured)
  • Testing data used to evaluate prediction accuracy

Model Evaluation Process

  • Black line predictions vs actual speeds:
    • Measure distance between predicted and actual for each person
    • Sum all distances for total error
  • Green squiggle predictions vs actual speeds:
    • Same process as black line
    • Despite better training data fit, larger total error on testing data
  • Black line performed better on testing data despite worse training fit
  • Conclusion: choose black line for predictions

Key Machine Learning Principles

  • Use testing data to evaluate machine learning methods
  • Don't be fooled by training data fit quality
  • Poor predictions despite good training fit = overfitting
  • Referenced bias-variance tradeoff concept

Method Selection Philosophy

  • Many fancy machine learning methods exist (deep learning, CNNs, etc.)
  • New methods appear annually
  • Most important factor: performance on testing data, not fanciness
  • Testing data performance determines method selection

Decision Tree Validation Example

  • Training data: people who love/don't love Stack Quest
  • Testing data: additional people for validation
  • Example person 1: didn't like silly songs, ML, or statistics
    • Tree predicted: won't love Stack Quest
    • Reality: loves Stack Quest (prediction error)
  • Example person 2: liked silly songs and ML
    • Tree predicted: will love Stack Quest
    • Reality: loves Stack Quest (correct prediction)
  • Process: run all testing data through tree, compare predictions to reality
  • Compare decision tree performance to other ML methods

Training vs Testing Data Selection

  • Earlier examples arbitrarily assigned data to training/testing sets
  • Red dots chosen as training, blue dots as testing
  • Could have been reversed
  • Proper methods exist for determining training/testing split
  • Referenced additional Stack Quest resources for this topic

Conclusion and Resources

  • Machine learning = making predictions and classifications
  • Many fancy methods available
  • Key principle: select method based on testing data performance
  • Additional Stack Quest episodes available for step-by-step ML concepts
  • Merchandise and support options mentioned

TwinMind

Get summaries like this for your own meetings

TwinMind takes notes in the background during meetings, lectures, and calls, then writes the summary for you.

Free plan to get started

No bot joins your calls

Phone, desktop & Chrome apps

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome