AI summary by TwinMind
Yuval Harari's Warning About New Alien Intelligences
Sabine Hossenfelder
8m 24s
Yuval Harari Interview Context
- Found interview on X Twitter about AI future predictions
- Elon Musk comment: "this is probably true"
- Speaker disagrees with Harari's predictions
- Harari predicts: algorithms/AIs running world in 10 years
- Not Hollywood sci-fi scenario of one big computer
- "Bureaucracy of AIs" - millions of AI bureaucrats
- In banks, government, businesses, universities
- Making more decisions about human lives
Harari's Background & Credibility
- Medieval historian according to Google
- Speaker questions AI expertise credentials
- Sarcastic reference to "Sir Lancelot developing battle strategy with ChatGPT"
Banking Industry AI Use
- Speaker attended mega conference of finance/banking managers
- All discussing artificial intelligence
- Banking people claim they'll never leave decisions to AI
- Customers worried about AI decision-making
- Will use AI anyway but won't admit it
- Computer analysis used in banking for decades
- Pattern recognition for credit decisions
- Look at similar people's previous experience
- Machine learning good at this type of task
- Banks already using this technology, now just calling it "AI"
- AI recommendations obvious: maximize bank profits
- Conclusion: basically nothing new in banking
Hiring Decisions & AI
- Most employers lack sufficient data to train AI effectively
- Background checks already standard practice
- Europe peculiar about health data privacy
- Don't want employers knowing about mental breakdowns
- Example: "sitting on toilet at wrong angle"
- Upper management resistance to AI hiring decisions
- Think they're smartest, don't want AI telling them what to do
- If they use AI, won't admit it
- Unlikely hiring decisions will rely much on AI
Universities & AI
- Any innovation in higher education would be improvement
Government AI Applications
- Democratic voting could continue (president/prime minister)
- Problem: if most decisions made by AIs
- Humans (including politicians) don't understand AI reasoning
- Power gradually shifts from humanity to "alien intelligences"
- Most plausible government AI use case:
- Inform decisions requiring lots of information
- Proper responses to geopolitical tensions
- Palantir working on this type of application
- Intelligence organizations also involved
- Predicting impact of taxes, regulations, tariffs
- AI advantage: too much information for humans to comprehend quickly
- Government investment recommendation:
- All nations should invest in supercomputer clusters
- Staff to train their own AI
- Otherwise "very big problem" in few years
Rishi Sunak's "Brit GPT" Plan
- People made jokes about former UK PM's plan
- Speaker thinks brilliant idea despite uninspired name
- Chinese doing exactly same thing
- Germans would get there "in century or two"
- Suggests name "Spotty Mabot Face" instead
AI Transparency & Understanding
- Will we understand why AI makes suggestions? "In most cases no"
- Use AIs in situations humans cannot comprehend
- Not good thing - vastly increases risk for catastrophic mistakes
- AIs need benchmark sanity checks
- Someone working on this problem
Historical Context & Comparison
- Government reliance on committees not new
- Committees → experts → scientific publications → peer review
- Committees as much "black boxes" as AI
- Example: EU's "idiotic plan of hydrogen economy"
- Nobody understands decision-making process
Harari Agreement & Disagreement
- Twitter interview part of 2-hour conversation
- Speaker agrees with "pretty much everything" Harari says
- Key disagreement: Harari confusing lack of understanding with lack of control
- Philosophy: "Don't understand what's going on in world? Turn it off and back on again"
Personal Data Privacy Segment
- Speaker's experience with spam calls 2 years ago
- Phone number appeared online, had to change number
- Suspicious about private information sharing
- Incog service promotion:
- Websites collect data about users and location
- Personal details sold to data brokers for profit
- Most countries have laws against this
- Can request data removal but time-consuming
- Incog automates removal process from databases
- Contacts "big sinners" to request personal detail removal
- Provides progress updates
- 60% off with code "zabina" for first 100 people
