AI summary by TwinMind
3. Learning: The Power of Association (audio only)
MIT OpenCourseWare
1h 18m 47s
Course Introduction and Syllabus Discussion
- Professor discusses syllabus compliance test - quote "what a warrior your mother would have been" from John Steinbeck's Arthurian literature rewrite
- Quote intentionally ungoogleable to ensure students read syllabus
- Students failed to recognize quote except Rachel (who was told beforehand)
Learning vs Memory Distinction
- Today's focus: association learning (not memory storage/retrieval covered later)
- Association learning: phylogenetically old, reflexive form appearing in all species
- Eric Kandel Nobel Prize winner for simple association learning research in Aplysia (sea slug)
- Sea slug looks like "dill pickle with about as much personality" but capable of learning
Classical (Pavlovian) Conditioning
Basic Paradigm
- Ivan Pavlov: Nobel Prize for digestive enzyme research, discovered conditioning accidentally
- Original setup: cannula in dog's cheek to collect saliva for meat powder studies
- Dog began salivating before meat powder appeared - anticipatory response
- Standard paradigm: Unconditioned Stimulus (US) = food → Unconditioned Response (UR) = saliva
- Conditioned Stimulus (CS) = bell paired with food
- Result: CS alone produces Conditioned Response (CR) = saliva
Key Constraints and Rules
Stimulus Salience and Overshadowing
- Must notice CS-US relationship
- Overshadowing: loud bell + dim light → bell captures learning, light doesn't
- Control experiment: dim light alone can produce learning in isolation
Predictive Relationship Critical
- CS must predict US, not just co-occur
- Example: drinking before bombing midterm vs. drinking generally
- Perfect prediction produces strongest learning
- Imperfect correlation produces weaker, slower learning
Extinction and Spontaneous Recovery
- Stopping US after CS leads to extinction of CR
- Extinction doesn't erase original learning
- Spontaneous recovery: CR returns after break, then extinguishes again
- Like relationship analogy: response returns after summer vacation
Temporal Constraints
- Optimal CS-US interval: 1-2 seconds
- No learning with simultaneous presentation (zero interval)
- Little learning with backward conditioning (US then CS)
- Narrow time window for association detection
- Real-world example: bump signs must precede bumps to be useful
Sensory Preconditioning
- Stage 1: Light-tone pairing (no salivation)
- Stage 2: Tone-food pairing (tone produces salivation)
- Test: Light alone produces salivation
- Demonstrates chaining: light→tone→food reasoning
- Example: "in summary" phrase → hunger response through learned association chains
- Shows how simple associations build complex behaviors
Operant (Skinnerian) Conditioning
Basic Paradigm
- BF Skinner: learning associations between actions and consequences
- Thorndike's Law of Effect: behaviors followed by positive consequences increase
- Skinner box: controlled environment with response key and food dispenser
Shaping Behavior
- Pigeons don't spontaneously peck keys
- Gradual shaping required: reward successive approximations
- Process: face wall → move closer → look at key → peck key
- Professor's lab story: shaped pigeon to make three full turns for food
- Basis of trained animal acts
Human Applications
- Jokes: laughs reinforce repetition, negative reactions extinguish
- Professor conditioning experiment: students reinforced leftward movement with attention
- Professor unaware of being conditioned despite believing it possible
Schedules of Reinforcement
Fixed Ratio (FR)
- FR1: reward every response
- FR10: reward every 10th response
- Higher ratios produce faster responding (work harder for same reward)
Variable Ratio (VR)
- VR10: average of every 10 responses rewarded
- Produces highest response rates
- Slot machine example: unpredictable rewards maintain gambling
Fixed Interval (FI)
- Reward first response after set time interval
- Produces scalloped response pattern: low responding post-reward, accelerating toward interval end
- Examples: paper writing, weekend chores, work attendance patterns
Extinction in Operant Conditioning
- VR schedules produce slower extinction than FR schedules
- Slot machine vs. Coke machine analogy
- Slot machines designed with reinforcing sounds, communal environment
Real-World Applications
Child Rearing Problems
- Cookie requests: FR1 → VR schedule through parental inconsistency
- Sleep training: intermittent reinforcement creates persistent crying
- Creates high-rate, extinction-resistant behaviors
"Getting to Yes" Phenomenon
- Sexual behavior requests typically male-initiated, initially refused
- Eventually rewarded on VR schedule
- Males report falling in love faster than females
- Breakup situations: VR-trained behavior extremely extinction-resistant
- Potential harassment implications
Specialized Learning Systems
Taste Aversion (Garcia Effect)
- John Garcia's research on flavor-illness associations
- One-trial learning: single pairing creates strong aversion
- Specific constraints: flavors (not visual stimuli) associate with illness
- Extended time window: hours between consumption and illness
- Evolutionary function: prevent poisoning in omnivores
- Cognitive impenetrability: persists despite knowing illness cause
Problems with Alcohol
- Alcohol has minimal flavor
- Aversion develops to mixers (orange juice) or accompanying foods (pretzels)
- Not the actual problematic substance (alcohol)
Superstitious Behavior
- Skinner's term for accidentally reinforced behaviors
- Baseball examples: pre-performance rituals shaped by occasional success
- Exam behaviors: precise pencil arrangements, food positioning
- Law of Effect shapes behaviors occurring before positive outcomes
Behaviorism as Psychological School
Core Principles
- John Watson: founder of American behaviorism
- Psychology as "science of behavior" only - no consciousness, mental states
- Classical and operant conditioning as "atoms of behavior"
- All complex behavior built from these basic elements
- Analogy to chemistry: basic elements explain everything
Ideological Components
Empiricism vs. Nativism
- Empiricism: environment shapes behavior through learning
- Nativism: genetic endowment determines behavior
- Behaviorism strongly empiricist
- Democratic ideology: "anyone can be president" through proper environmental shaping
Why Behaviorism Declined
Incomplete Psychology
- Excluded legitimate topics: consciousness, emotion, subjective experience
- Too restrictive ideologically
Not Everything is Learnable
- Language acquisition requires innate learning mechanisms
- Innate endowments worth studying independently
- Evolution provides explanatory power but isn't complete psychology
Extreme Positions Don't Work
- Answer in psychology typically "both" nature and nurture
- Need balance between empiricist and nativist perspectives
Course Context
- Association learning principles remain valuable (Chapter 4 reading)
- Foundation for understanding more complex psychological phenomena
- Not complete explanation but important building blocks
