AI summary by TwinMind
Judea Pearl: Causal Reasoning, Counterfactuals, and the Path to AGI | Lex Fridman Podcast #56
Lex Fridman
1h 23m 1s
Introduction & Background
- Judea Pearl: UCLA professor, Turing Award winner (Nobel Prize of computing)
- Seminal figure in AI, computer science, statistics
- Developed probabilistic approaches to AI including Bayesian networks
- Pioneer in causality - ideas crucial for building truly intelligent systems
- Wrote "Book of Why" to make causality accessible to general public
Early Life & Mathematical Awakening
- First mystery that captivated him: Descartes and analytic geometry
- Had fever for 3 days learning geometry can be done using algebra
- Traumatic/transformative experience realizing connection between mathematical disciplines
- Teachers were German refugees from 1930s Hitler era who came to Israel
- Left careers in Heidelberg/Berlin to teach high school
- Taught mathematics with historical context and personalities
- Connected every theorem with person, time period, stories
Educational & Career Path
- BS in Engineering at Technion
- Graduate work in engineering and physics at Rutgers
- PhD thesis in superconductivity at Bell Labs
- Has "Pearl vortex" named after him in superconductivity (discovered 15 years later)
- Transitioned from physics to computer science/AI
Philosophy of Science & Reality
- Universe is stochastic at quantum level but deterministic for practical AI purposes
- Quantum mechanics only governs microscopic phenomena - diversionary for AI
- Free will is illusion that AI will solve
- Solution: machine that acts as though it has free will, communicates with others as if they have free will
- "Faking intelligence is intelligence because it's not easy to fake - you can only fake if you have it"
Probability & Correlation
- Probability = degree of uncertainty an agent has about the world
- 90% vs 10% represents different kinds of solid, useful knowledge
- Correlation occurs when variables vary together over time
- When we think correlation, we really think causation - things can't correlate without reason
- Conditional probability: how things vary when one stays the same
- Can create correlation where none exists physically through selective observation
Machine Learning as Association
- Current ML/deep neural networks are conditional probability estimators
- ML today only learns by association, not causation
- Will hit wall without incorporating causal reasoning
- Association ≠ causation - fundamental limitation of current approaches
Bayesian Networks to Causal Networks
- Bayesian networks look like causation but don't necessarily express it
- To build causal networks: ask what factors determine value of X
- Need human expert to specify initial qualitative model
- Start with "who listens to whom" - basic causal relationships
- AI slogan: "Representation first, discovery second"
Do-Calculus & Intervention
- Do-operator distinguishes association from intervention
- Doing X = cutting incoming arrows to X in causal model, looking at probability of Y
- Represents liberation from natural influences, subjecting to "tyranny of your muscles"
- Can conduct hypothetical experiments on models even when physical experiments impossible
- Example: effect of blood pressure on mortality - can't physically change blood pressure but can model it
Causal Discovery from Data
- Need assumptions about causal structure (arrows in graph)
- More arrows = less identifiable from observational data alone
- If graph too "mushy bushy" need experiments or different observations
- Don't encode more than you know - every arrow says "it's possible"
- Can sometimes use natural experiments, random noise, unexpected events
Counterfactuals - Highest Level of Reasoning
- Counterfactuals enable explanation, responsibility, regret
- Example: "Was it aspirin that cured my headache?" requires considering what would have happened without aspirin
- Contains logical clash between observed fact and hypothetical
- Source of explanation, responsibility, regret, free will concepts
- Physicists use counterfactuals constantly but equations lack asymmetry
Building Causal AI Systems
- Robots need causal models to reason about interventions and counterfactuals
- Babies learn through playful manipulation + parent guidance + peer wisdom + hearsay
- Challenge: integrating multiple sources of causal information
- Physical manipulation requires extremely complex causal knowledge
- Approach: combining simple models from many sources and disciplines
Metaphors in Intelligence
- Metaphors = expert systems mapping unfamiliar to familiar problems
- All human intelligence built around metaphors
- Example: Greeks' sky as opaque sheet with holes (stars) enabled Eratosthenes to measure Earth's radius
- Familiar = answers to questions are explicit, don't need derivation
- Chess masters store explicit evaluations of complex patterns vs. deriving them
Current AI Revolution & Future
- Tremendous progress in causal reasoning - calls it "causal revolution"
- Past 3 decades dwarf entire previous history of causal understanding
- Human provides qualitative models, machine derives quantitative answers
- Can generalize across diverse populations and conditions using do-calculus
- Powerful for medical applications, big data with multiple sources
Machine Learning Integration
- ML and causality must work in harmony, not collision
- Humans jumpstart with qualitative models
- Machines take over for complex quantitative derivations
- Example: inferring cause-effect in new populations from diverse studies
Consciousness & Free Will in Machines
- Free will test: robots communicating rewards/punishments, playing better soccer
- Consciousness = having blueprint of your software, self-model
- Looking at yourself as part of environment
- Ethical machines need empathy - model of recipient's suffering
- Compassion = imagining others suffer pain as much as you
AI Safety Concerns
- Building new species capable of exceeding human capabilities
- Can breed itself, take over world - uncontrolled
- Don't understand what it means to control this species
- Sample size of one (human evolution) plus theory/conjecture
- Feels helpless contributing due to limited knowledge/imagination
- Definitely concerned about the future
Personal History - Israel & Military Service
- Born and raised in Israel, served in IDF
- NAHAL service combining agricultural work and military
- Originally wanted lifelong kibbutz membership, communal life
- Witnessed miracle of Israel's survival and growth
- Population tripled from 600K to 1.8M during austerity
- No one went hungry, higher education maintained investment
- Close to second genocide in 1948 war
Religion & AI
- Should robots have religious beliefs? Will develop them naturally through metaphor
- Most primitive metaphor: parent figures become God concept
- Robot will map cosmology to programmer - that becomes God
- Religion useful as long as kept as metaphor
- Question whether religion overall served humanity well
Personal Tragedy - Daniel Pearl
- Son Daniel abducted and executed by Al-Qaeda in Pakistan
- Core issue: hate and intolerance from deep indoctrination
- Billions educated with unappreciated depth of hatred
- All humans capable of evil given sufficient indoctrination
- Worry about transformation under economic crisis/circumstances
Normalization of Evil
- Article "Daniel Pearl and the Normalization of Evil" - feels he lost this battle
- Terrorism no longer treated as taboo
- Grievance → bombing restaurants became normalized
- Banalization of evil through political debate
- Terrorist/freedom fighter labels switchable
- Must separate good from evil - biblical tree of knowledge
Memory of Daniel
- Daniel was his mentor with better sense of balance
- Saw beauty in every person, less emotional, more perspective
- Grew up seeing foreigners as curiosity not fear
- Story of hugging homeless person vs. father's retreat
- Today is Father's Day during interview
Advice for Young Researchers
- Ask your questions - never dumb
- Solve them your own way
- Don't take "no" for answer
- Follow questions, understand things your way
- Trial and error will reveal if truly leading nowhere
- Inertia in academia slows science
- Wrote "Book of Why" to democratize common sense, instill rebellious spirit
- Students shouldn't wait for professors to get things right
Legacy
- Already has tombstone carved
- Wants to be remembered for: "The fundamental law of counterfactuals"
- Simple equation putting counterfactuals in terms of model surgery
- Everything else follows from this foundation
- Students can derive all knowledge mathematically from this principle
