AI summary by TwinMind

Faceswapping, Unethical Videos, and Future Shock

Tom Scott

6m 40s

Original Science Fiction Story Concept

  • Planned story about mass blackmail using face-swapping technology
  • Fictional app concept: swap your face into movie scenes using smartphone camera
  • Story structure: protagonist, narrative arc, warning about future misuse
  • Reality arrived faster than expected - "news happened"

Discovery and Investigation of Real Face-Swapping Software

  • Found actual code available for couple of months
  • Originally developed for non-consensual pornography
  • Someone packaged complex code into Windows app last week
  • System requirements: Windows 10 PC, powerful Nvidia graphics card, moderate tech skills, "poor or no sense of empathy"
  • Found software on Reddit, downloaded 2.6 gigabytes

Technical Testing Process

  • Used old machine, wiped clean for safety
  • Unfriendly interface with error messages, no help files
  • Asked friend Matt Parker for permission to use his videos
  • Extracted 500 frames from Matt's YouTube channel, 500 from own
  • Extraction process: align eyes, nose, mouth in same place
  • Created "creepy gif" from process

Training Results and Performance

  • 10 minutes: rough results
  • 1 hour: starting to become recognizable
  • 24 hours: still blurred, graphics card nearly overheating
  • 48 hours: some results good enough to try
  • Final test: could not convincingly face swap Matt Parker into video
  • Reverse test also failed

Professional Quality Example

  • News article showed perfect face swap
  • Amy Adams/Nicolas Cage clip demonstration
  • Hollywood CGI quality achieved by one person in couple days
  • Neither person consented to the swap
  • Ethical concerns about acceptability thresholds

Future Implications and Concerns

  • Technology will become easier - current days of training won't be required long-term
  • Someone will package algorithm as "fun app" for movies rather than current horrible uses
  • "As of last week you can no longer trust a video of someone unless you also trust its source"
  • Political implications: alleged Donald Trump tape scenario with body double

Algorithmic Blackmail Scenario

  • Script to pull selfies from Instagram accounts
  • Train algorithm to create plausible fake porn
  • Automated blackmail threats as if from hidden/hacked webcam
  • Economic viability: few people falling for it = decent income
  • Particularly effective for senders in developing countries with lower cost of living
  • Causes emotional trauma to huge number of people

Societal Readiness Assessment

  • "We're not ready for this as a society, as humanity"
  • No upbeat ending available - this is no longer science fiction
  • Conclusion: "vague sense of future shock"

TwinMind

Get summaries like this for your own meetings

TwinMind takes notes in the background during meetings, lectures, and calls, then writes the summary for you.

Free plan to get started

No bot joins your calls

Phone, desktop & Chrome apps

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome