AI summary by TwinMind

3. Learning: The Power of Association (audio only)

MIT OpenCourseWare

1h 18m 47s

Course Introduction and Syllabus Discussion

  • Professor discusses syllabus compliance test - quote "what a warrior your mother would have been" from John Steinbeck's Arthurian literature rewrite
  • Quote intentionally ungoogleable to ensure students read syllabus
  • Students failed to recognize quote except Rachel (who was told beforehand)

Learning vs Memory Distinction

  • Today's focus: association learning (not memory storage/retrieval covered later)
  • Association learning: phylogenetically old, reflexive form appearing in all species
  • Eric Kandel Nobel Prize winner for simple association learning research in Aplysia (sea slug)
  • Sea slug looks like "dill pickle with about as much personality" but capable of learning

Classical (Pavlovian) Conditioning

Basic Paradigm

  • Ivan Pavlov: Nobel Prize for digestive enzyme research, discovered conditioning accidentally
  • Original setup: cannula in dog's cheek to collect saliva for meat powder studies
  • Dog began salivating before meat powder appeared - anticipatory response
  • Standard paradigm: Unconditioned Stimulus (US) = food → Unconditioned Response (UR) = saliva
  • Conditioned Stimulus (CS) = bell paired with food
  • Result: CS alone produces Conditioned Response (CR) = saliva

Key Constraints and Rules

Stimulus Salience and Overshadowing

  • Must notice CS-US relationship
  • Overshadowing: loud bell + dim light → bell captures learning, light doesn't
  • Control experiment: dim light alone can produce learning in isolation

Predictive Relationship Critical

  • CS must predict US, not just co-occur
  • Example: drinking before bombing midterm vs. drinking generally
  • Perfect prediction produces strongest learning
  • Imperfect correlation produces weaker, slower learning

Extinction and Spontaneous Recovery

  • Stopping US after CS leads to extinction of CR
  • Extinction doesn't erase original learning
  • Spontaneous recovery: CR returns after break, then extinguishes again
  • Like relationship analogy: response returns after summer vacation

Temporal Constraints

  • Optimal CS-US interval: 1-2 seconds
  • No learning with simultaneous presentation (zero interval)
  • Little learning with backward conditioning (US then CS)
  • Narrow time window for association detection
  • Real-world example: bump signs must precede bumps to be useful

Sensory Preconditioning

  • Stage 1: Light-tone pairing (no salivation)
  • Stage 2: Tone-food pairing (tone produces salivation)
  • Test: Light alone produces salivation
  • Demonstrates chaining: light→tone→food reasoning
  • Example: "in summary" phrase → hunger response through learned association chains
  • Shows how simple associations build complex behaviors

Operant (Skinnerian) Conditioning

Basic Paradigm

  • BF Skinner: learning associations between actions and consequences
  • Thorndike's Law of Effect: behaviors followed by positive consequences increase
  • Skinner box: controlled environment with response key and food dispenser

Shaping Behavior

  • Pigeons don't spontaneously peck keys
  • Gradual shaping required: reward successive approximations
  • Process: face wall → move closer → look at key → peck key
  • Professor's lab story: shaped pigeon to make three full turns for food
  • Basis of trained animal acts

Human Applications

  • Jokes: laughs reinforce repetition, negative reactions extinguish
  • Professor conditioning experiment: students reinforced leftward movement with attention
  • Professor unaware of being conditioned despite believing it possible

Schedules of Reinforcement

Fixed Ratio (FR)

  • FR1: reward every response
  • FR10: reward every 10th response
  • Higher ratios produce faster responding (work harder for same reward)

Variable Ratio (VR)

  • VR10: average of every 10 responses rewarded
  • Produces highest response rates
  • Slot machine example: unpredictable rewards maintain gambling

Fixed Interval (FI)

  • Reward first response after set time interval
  • Produces scalloped response pattern: low responding post-reward, accelerating toward interval end
  • Examples: paper writing, weekend chores, work attendance patterns

Extinction in Operant Conditioning

  • VR schedules produce slower extinction than FR schedules
  • Slot machine vs. Coke machine analogy
  • Slot machines designed with reinforcing sounds, communal environment

Real-World Applications

Child Rearing Problems

  • Cookie requests: FR1 → VR schedule through parental inconsistency
  • Sleep training: intermittent reinforcement creates persistent crying
  • Creates high-rate, extinction-resistant behaviors

"Getting to Yes" Phenomenon

  • Sexual behavior requests typically male-initiated, initially refused
  • Eventually rewarded on VR schedule
  • Males report falling in love faster than females
  • Breakup situations: VR-trained behavior extremely extinction-resistant
  • Potential harassment implications

Specialized Learning Systems

Taste Aversion (Garcia Effect)

  • John Garcia's research on flavor-illness associations
  • One-trial learning: single pairing creates strong aversion
  • Specific constraints: flavors (not visual stimuli) associate with illness
  • Extended time window: hours between consumption and illness
  • Evolutionary function: prevent poisoning in omnivores
  • Cognitive impenetrability: persists despite knowing illness cause

Problems with Alcohol

  • Alcohol has minimal flavor
  • Aversion develops to mixers (orange juice) or accompanying foods (pretzels)
  • Not the actual problematic substance (alcohol)

Superstitious Behavior

  • Skinner's term for accidentally reinforced behaviors
  • Baseball examples: pre-performance rituals shaped by occasional success
  • Exam behaviors: precise pencil arrangements, food positioning
  • Law of Effect shapes behaviors occurring before positive outcomes

Behaviorism as Psychological School

Core Principles

  • John Watson: founder of American behaviorism
  • Psychology as "science of behavior" only - no consciousness, mental states
  • Classical and operant conditioning as "atoms of behavior"
  • All complex behavior built from these basic elements
  • Analogy to chemistry: basic elements explain everything

Ideological Components

Empiricism vs. Nativism

  • Empiricism: environment shapes behavior through learning
  • Nativism: genetic endowment determines behavior
  • Behaviorism strongly empiricist
  • Democratic ideology: "anyone can be president" through proper environmental shaping

Why Behaviorism Declined

Incomplete Psychology

  • Excluded legitimate topics: consciousness, emotion, subjective experience
  • Too restrictive ideologically

Not Everything is Learnable

  • Language acquisition requires innate learning mechanisms
  • Innate endowments worth studying independently
  • Evolution provides explanatory power but isn't complete psychology

Extreme Positions Don't Work

  • Answer in psychology typically "both" nature and nurture
  • Need balance between empiricist and nativist perspectives

Course Context

  • Association learning principles remain valuable (Chapter 4 reading)
  • Foundation for understanding more complex psychological phenomena
  • Not complete explanation but important building blocks

TwinMind

Get summaries like this for your own meetings

TwinMind takes notes in the background during meetings, lectures, and calls, then writes the summary for you.

Free plan to get started

No bot joins your calls

Phone, desktop & Chrome apps

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome