AI summary by TwinMind
Faceswapping, Unethical Videos, and Future Shock
Tom Scott
6m 40s
Original Science Fiction Story Concept
- Planned story about mass blackmail using face-swapping technology
- Fictional app concept: swap your face into movie scenes using smartphone camera
- Story structure: protagonist, narrative arc, warning about future misuse
- Reality arrived faster than expected - "news happened"
Discovery and Investigation of Real Face-Swapping Software
- Found actual code available for couple of months
- Originally developed for non-consensual pornography
- Someone packaged complex code into Windows app last week
- System requirements: Windows 10 PC, powerful Nvidia graphics card, moderate tech skills, "poor or no sense of empathy"
- Found software on Reddit, downloaded 2.6 gigabytes
Technical Testing Process
- Used old machine, wiped clean for safety
- Unfriendly interface with error messages, no help files
- Asked friend Matt Parker for permission to use his videos
- Extracted 500 frames from Matt's YouTube channel, 500 from own
- Extraction process: align eyes, nose, mouth in same place
- Created "creepy gif" from process
Training Results and Performance
- 10 minutes: rough results
- 1 hour: starting to become recognizable
- 24 hours: still blurred, graphics card nearly overheating
- 48 hours: some results good enough to try
- Final test: could not convincingly face swap Matt Parker into video
- Reverse test also failed
Professional Quality Example
- News article showed perfect face swap
- Amy Adams/Nicolas Cage clip demonstration
- Hollywood CGI quality achieved by one person in couple days
- Neither person consented to the swap
- Ethical concerns about acceptability thresholds
Future Implications and Concerns
- Technology will become easier - current days of training won't be required long-term
- Someone will package algorithm as "fun app" for movies rather than current horrible uses
- "As of last week you can no longer trust a video of someone unless you also trust its source"
- Political implications: alleged Donald Trump tape scenario with body double
Algorithmic Blackmail Scenario
- Script to pull selfies from Instagram accounts
- Train algorithm to create plausible fake porn
- Automated blackmail threats as if from hidden/hacked webcam
- Economic viability: few people falling for it = decent income
- Particularly effective for senders in developing countries with lower cost of living
- Causes emotional trauma to huge number of people
Societal Readiness Assessment
- "We're not ready for this as a society, as humanity"
- No upbeat ending available - this is no longer science fiction
- Conclusion: "vague sense of future shock"
