AI summary by TwinMind

Why The Web Is Such A Mess

Tom Scott

9m 50s

Tim Berners-Lee's Original Web Vision (1989)

  • Proposed "universal linked information system" in 1989
  • Envisioned "place to be found for any informational reference which one felt was important and a way of finding it afterwards"
  • Three decades later, web became "a bit of a mess"

Early Web Architecture & Stateless Design

  • Initial web: simple text, images, links to other text/images
  • Forms allowed information submission but system was stateless
  • Neither browser nor server tracked users between pages
  • Server forgot about users after each request - couldn't distinguish users on same network
  • Reliable + personalized functionality was impossible

Cookie Invention & Implementation (1994)

  • Lou Montouli at Netscape created cookies, adapting "magic cookies" computer science technique
  • Other browsers adopted cookies, became part of web standards
  • Cookie functionality:
    • Client-side storage - server sends page + small text file (cookie)
    • Browser saves cookie, sends with every subsequent request to same server
    • Could store preferences (dark mode settings)
    • Could last years even after browser/computer restarts
    • Used for authentication - long random character strings acting as passwords

Privacy Rule & Third-Party Cookie Loophole

  • Original privacy rule: Only site that sets cookie can read it back
  • Loophole: Web pages could include material from other servers
    • Images from elsewhere
    • Scripting code
    • Entire websites in frames
  • Other servers could set/read their own cookies = "third-party cookies"

Advertiser Tracking & Profile Building

  • Advertising companies set cookies tracking people across entire web
  • Same ad company partnering with multiple websites built detailed profiles
  • Profile building process:
    • Track visits: hometown website → college website → specific medical condition website → online shop
    • Combine shop details with cookie data
    • Add name/address to profile
  • Facebook share buttons reported back user browsing patterns
  • Result: targeted ads on seemingly unconnected sites

Regulatory Response - EU Cookie Law

  • EU acted first with "cookie law" (euphemistic name)
  • Required consent to place cookies in all EU member countries
  • Poorly implemented - confusing consent boxes
  • Most people clicked "OK" to access content
  • Browser makers began offering third-party cookie blocking options

Advertiser Adaptation - Fingerprinting

  • Shifted from cookies to fingerprinting techniques
  • Tracked users through:
    • Installed fonts
    • Monitor size
    • Previously visited websites
    • Individual computer setup quirks
    • Web page rendering characteristics
  • Individual elements appeared innocent but together uniquely identified users

Browser vs Advertiser Privacy War

  • "Odd war" between browser makers and advertisers
  • Sometimes "civil war" - same company owning popular browser and major advertising business

GDPR Implementation & Stronger Requirements

  • General Data Protection Regulation applied stronger rules
  • Requirements:
    • No tracking without consent for EU citizens
    • Full user knowledge of what they're signing up for
    • Applied even to non-EU companies storing EU citizen data
  • Penalties: 4% of global annual revenue OR €20 million (whichever higher)
  • EU could block non-compliant companies from European business

Advertiser Response Options

  • Option 1: Stop tracking people
  • Option 2: Add consent boxes on each page
  • Legal requirement: easy opt-out, simple one-click process
  • Reality: Often not true - complex opt-out processes

Web Design Freedom vs Abuse

  • Web built around freedom of design - fundamental principle
  • Programmers pushed limits for decades
  • Example: Entire Windows 95 virtual machine running in web browser
  • Abuse potential:
    • Newsletter signup interruptions
    • Cryptocurrency mining in background
    • Pop-up boxes and intrusive elements

Browser Reader Mode Response

  • Most browsers now offer "article view" or "reader mode"
  • Strips out adverts, pop-ups, design elements
  • Shows only main content text
  • Closer to Berners-Lee's original vision
  • Trade-off: Loses creativity and design freedom web allows

Ongoing Technical Arms Race

  • Techniques exist to detect and defeat reader view
  • Force users to see adverts/newsletter pop-ups
  • Every design freedom for creativity = freedom for abuse
  • Pattern applies beyond web to entire online world

TwinMind

Get summaries like this for your own meetings

TwinMind takes notes in the background during meetings, lectures, and calls, then writes the summary for you.

Free plan to get started

No bot joins your calls

Phone, desktop & Chrome apps

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome