AI summary by TwinMind

Why Is There So Much Fraud in Academia? (Update) | Freakonomics Radio

Freakonomics Radio Network

1h 15m 8s

Introduction & Context

  • Steven Dubner introduces holiday re-run of popular series about research scandals
  • High school teacher in Frisco, Texas created crossword puzzle based on series
  • Fraud clue: "active fabrication of data" (5 letters)
  • Updated facts/figures where necessary; part two coming next week

Franchesca Gino Case Overview

  • Harvard Business School professor, former "academic superstar"
  • Research focus: organizational behavior, decision science, behavioral psychology
  • Published extensively, authored books including "Rebel Talent: Why It Pays to Break the Rules"
  • Consulted for Google, Disney, Walmart, US Air Force, Army, Navy
  • July 2023: Harvard suspended without pay for "intentionally, knowingly, or recklessly committed research misconduct"
  • Gino sued Harvard and whistleblowers
  • Maintains innocence, claims never fabricated data

Dan Ariely Case Overview

  • Duke University behavioral scientist
  • Author of "Predictably Irrational" (2008)
  • Also accused of data fraud by same whistleblowers
  • Claims Duke investigated and cleared him (Duke declined public comment)
  • Book inspired NBC crime drama "The Irrational" (second season)
  • Maintains innocence regarding data fabrication

Academic Fraud Scope & Impact

  • Nature journal study: 10,000+ research articles retracted last year (record-breaking)
  • Countries with most retractions: Saudi Arabia, Pakistan, Russia, China
  • Historical context: fraud existed since Ptolemy (2nd century Greek astronomer)
  • Real-world consequences: Wakefield vaccine-autism scandal example
  • Academic waste: false ideas lead to wasted follow-up research

Brian Nosek & Center for Open Science

  • University of Virginia psychology professor
  • Founded Center for Open Science (2013) - nonprofit improving research integrity
  • Funding: NIH, NSF, NASA, DARPA, John Templeton Foundation, Arnold Foundation
  • Academic reward system problem: "publication is currency of advancement"
  • Researchers reluctant to share data due to career competition

Reproducibility Crisis

  • 2015 reproducibility project: 270 co-authors, 100 replications from 3 psychology journals
  • Result: "little less than half" successfully replicated
  • Cancer biology project: similar results (less than 50% replication rate)
  • Failure to replicate ≠ fraud, but suggests lasting value problems
  • Economics appears more resistant to fraud due to:
    • Mathematical rigor, robustness checks
    • Aggressive peer debate culture
    • Larger, often public datasets
    • Less cheating opportunity

Data Colada Team Introduction

  • Le Nelson (UC Berkeley), Yuri Simonson (IESE Barcelona), Joe Simmons (Wharton)
  • Mid-career researchers with high-status positions
  • Run blog "Data Colada" (launched late 2013)
  • Focus: examining research methodology, identifying problems

P-Hacking & Research Practices

  • "False Positive Psychology" paper showing people get younger listening to "When I'm 64"
  • P-hacking examples:
    • Measuring multiple variables, reporting only favorable ones
    • Dropping treatment conditions without disclosure
    • Selective outlier removal/statistical transformations
  • "Convenient errors": typos that favor hypotheses (e.g., 5.1 becomes 51.2)

Data Colada Investigations

  • First blog post: identified fraudulent data with impossible values (negative numbers on 1-9 scale)
  • 2012 Taiwanese researchers paper retracted
  • Estimated fraud rate: ~5% of articles
  • Focus on high-profile journals due to resource constraints

"Signing at the Top" Paper Investigation

  • 2012 PNAS paper: "Signing at the Beginning Makes Ethics Salient"
  • Claimed signing forms at top increases honesty vs. bottom
  • Edited by Danny Kahneman
  • Co-authors: Dan Ariely, Franchesca Gino, Nina Mazar, Lisa Shu, Max Bazerman
  • Widely implemented by firms, government agencies (including IRS)
  • 2020 follow-up paper showed effect didn't replicate

Max Bazerman's Account

  • Harvard Business School professor, senior researcher
  • Co-authored "signing at top" paper as mentor to Lisa Shu (doctoral student)
  • Franchesca Gino provided lab data from UNC Chapel Hill
  • Bazerman questioned unusually high mileage data (24-27k miles/year vs. 13k national average)
  • Ariely claimed "senior citizens in Florida" explanation
  • Nina Mazar showed database, explained timing issue
  • Paper published despite concerns

Replication Failures & Investigation

  • 2016: Bazerman's cousin Stuart contacted about insurance startup
  • Multiple online replication attempts failed (6 times)
  • Large-scale lab replication with 10x subjects also failed
  • 2020: Published failure-to-replicate paper in PNAS
  • Original paper not retracted initially

Data Colada Fraud Evidence

  • June 2021: Data Colada contacted Bazerman via Zoom
  • Insurance study evidence:
    • Histogram showed uniform distribution (0-50k miles) - statistically impossible
    • Insurance company confirmed data differed from what they provided
    • No difference between top/bottom signing in original data
  • Additional evidence in Gino's lab studies
  • "Cluster fake" - multiple frauds in same paper

Legal Consequences

  • Franchesca Gino sued Data Colada and Harvard for $25 million (defamation)
  • Claimed sex discrimination by Harvard
  • GoFundMe raised $200k+ for Data Colada defense within 24 hours
  • Massachusetts judge dismissed lawsuit against Data Colada
  • Harvard lawsuit continues; tenure review ongoing

Systemic Issues & Reform

  • Simine Vazire (Melbourne/Psychological Science editor): culture lacks open criticism
  • Incentives favor exaggeration over calibrated findings
  • "If you were rational agent acting self-interested way, you would cheat"
  • Psychology field in "crisis of integrity/credibility"
  • Public skepticism appropriate for complex, messy social science claims

Bazerman's Reflection

  • Admits complicity in not verifying databases
  • "I should be somewhat accountable for not doing better job of verifying"
  • Wished he'd examined 2011 insurance database directly
  • Emphasizes majority of social science research is honest and valuable
  • Warns fraud headlines may devalue legitimate research

Future Implications

  • Part two promises coverage of research paper mills
  • Hundreds to thousands of dollars per paper
  • Tens of thousands of papers published annually
  • Financial scale analysis upcoming

TwinMind

Get summaries like this for your own meetings

TwinMind takes notes in the background during meetings, lectures, and calls, then writes the summary for you.

Free plan to get started

No bot joins your calls

Phone, desktop & Chrome apps

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome