AI summary by TwinMind
AI experts make predictions for 2040. I was a little surprised. | Science News
Sabine Hossenfelder
6m 57s
Research Methodology
- UK researchers conducted systematic interviews with 12 software development experts
- Used Delphi method (named after Oracle of Delphi, invented by RAND Corporation in 1950s)
- Multiple rounds of in-depth interviews
- Transcribed and anonymously shared with participants
- Participants add opinions on each other's interviews
- Process repeated several times
- Goal: leverage expert knowledge for actionable plans about software development by 2040
Five Key Expert Consensus Points
AI Safety Corners Will Be Cut by 2040
- All experts agree safety shortcuts will happen
- NOT due to company competition but nation-state competition
- Specifically between United States and China
- Chart shows blue (agreement), orange (disagreement), white (no opinion)
AI-Caused Mega Deaths
- 2 experts predict AI will cause events with ≥1 million deaths by 2040
- "Mega Death" is actual unit, not just heavy metal band name
- Some experts disagree but only on scale (thousands vs millions of deaths)
Quantum Computing Limited Commercial Impact
- All experts agree quantum computing will "only just be used" by 2040
- Some disagreement by degree - already exists but no commercial relevance
- Won't change significantly by 2040
Truth vs Fiction Crisis
- Almost all experts worried AI will make truth/fiction distinction increasingly difficult
- Affects written text, images, video across domains
- Predicts arms race: some AIs produce fake content, others try to identify fakes
- Risk of accidentally flagging truth as fake
- Expert quote: "Not living in George Orwell world, but Philip K. Dick world where nobody knows what's true"
- Reference to dystopian novels like "Do Androids Dream of Electric Sheep" (adapted as Blade Runner)
Digital Asset Tokenization
- Experts agree buying/owning internet assets via tokens will become common by 2040
- Tokenization = digital record keeping (what NFTs known for)
- Will NOT happen through blockchain technology
- Will use other distributed services instead
- Expert quote: "blockchain has now proved its irrelevance"
Software Complexity and Attribution Problems
- Increasing complexity of software and AI will make accidents vs deliberate manipulation indistinguishable
- No humans will be able to figure out what's happening
- Comparison to "modern-day STUXNET"
Expert Recommendations
- Regulations on AI safety
- Built-in safety requirements and outcome checks
- "Ambient accountability" in software development
- Better education for people in relevant positions
- More input from social sciences on impact assessment
Additional Commentary
- Presenter identifies blind spot: scientific publication integrity
- AI will make producing fake papers and data dramatically easier
- Already happening as we speak
- Special concern because fact-checkers rely on scientific publications
- If scientific base erodes, entire information ecosystem will collapse
