AI summary by TwinMind

Yuval Harari's Warning About New Alien Intelligences

Sabine Hossenfelder

8m 24s

Yuval Harari Interview Context

  • Found interview on X Twitter about AI future predictions
  • Elon Musk comment: "this is probably true"
  • Speaker disagrees with Harari's predictions
  • Harari predicts: algorithms/AIs running world in 10 years
    • Not Hollywood sci-fi scenario of one big computer
    • "Bureaucracy of AIs" - millions of AI bureaucrats
    • In banks, government, businesses, universities
    • Making more decisions about human lives

Harari's Background & Credibility

  • Medieval historian according to Google
  • Speaker questions AI expertise credentials
  • Sarcastic reference to "Sir Lancelot developing battle strategy with ChatGPT"

Banking Industry AI Use

  • Speaker attended mega conference of finance/banking managers
  • All discussing artificial intelligence
  • Banking people claim they'll never leave decisions to AI
    • Customers worried about AI decision-making
    • Will use AI anyway but won't admit it
  • Computer analysis used in banking for decades
    • Pattern recognition for credit decisions
    • Look at similar people's previous experience
    • Machine learning good at this type of task
  • Banks already using this technology, now just calling it "AI"
  • AI recommendations obvious: maximize bank profits
  • Conclusion: basically nothing new in banking

Hiring Decisions & AI

  • Most employers lack sufficient data to train AI effectively
  • Background checks already standard practice
  • Europe peculiar about health data privacy
    • Don't want employers knowing about mental breakdowns
    • Example: "sitting on toilet at wrong angle"
  • Upper management resistance to AI hiring decisions
    • Think they're smartest, don't want AI telling them what to do
    • If they use AI, won't admit it
  • Unlikely hiring decisions will rely much on AI

Universities & AI

  • Any innovation in higher education would be improvement

Government AI Applications

  • Democratic voting could continue (president/prime minister)
  • Problem: if most decisions made by AIs
    • Humans (including politicians) don't understand AI reasoning
    • Power gradually shifts from humanity to "alien intelligences"
  • Most plausible government AI use case:
    • Inform decisions requiring lots of information
    • Proper responses to geopolitical tensions
    • Palantir working on this type of application
    • Intelligence organizations also involved
  • Predicting impact of taxes, regulations, tariffs
  • AI advantage: too much information for humans to comprehend quickly
  • Government investment recommendation:
    • All nations should invest in supercomputer clusters
    • Staff to train their own AI
    • Otherwise "very big problem" in few years

Rishi Sunak's "Brit GPT" Plan

  • People made jokes about former UK PM's plan
  • Speaker thinks brilliant idea despite uninspired name
  • Chinese doing exactly same thing
  • Germans would get there "in century or two"
  • Suggests name "Spotty Mabot Face" instead

AI Transparency & Understanding

  • Will we understand why AI makes suggestions? "In most cases no"
  • Use AIs in situations humans cannot comprehend
  • Not good thing - vastly increases risk for catastrophic mistakes
  • AIs need benchmark sanity checks
  • Someone working on this problem

Historical Context & Comparison

  • Government reliance on committees not new
  • Committees → experts → scientific publications → peer review
  • Committees as much "black boxes" as AI
  • Example: EU's "idiotic plan of hydrogen economy"
  • Nobody understands decision-making process

Harari Agreement & Disagreement

  • Twitter interview part of 2-hour conversation
  • Speaker agrees with "pretty much everything" Harari says
  • Key disagreement: Harari confusing lack of understanding with lack of control
  • Philosophy: "Don't understand what's going on in world? Turn it off and back on again"

Personal Data Privacy Segment

  • Speaker's experience with spam calls 2 years ago
  • Phone number appeared online, had to change number
  • Suspicious about private information sharing
  • Incog service promotion:
    • Websites collect data about users and location
    • Personal details sold to data brokers for profit
    • Most countries have laws against this
    • Can request data removal but time-consuming
    • Incog automates removal process from databases
    • Contacts "big sinners" to request personal detail removal
    • Provides progress updates
    • 60% off with code "zabina" for first 100 people

TwinMind

Get summaries like this for your own meetings

TwinMind takes notes in the background during meetings, lectures, and calls, then writes the summary for you.

Free plan to get started

No bot joins your calls

Phone, desktop & Chrome apps

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome