AI summary by TwinMind
Why The Web Is Such A Mess
Tom Scott
9m 50s
Tim Berners-Lee's Original Web Vision (1989)
- Proposed "universal linked information system" in 1989
- Envisioned "place to be found for any informational reference which one felt was important and a way of finding it afterwards"
- Three decades later, web became "a bit of a mess"
Early Web Architecture & Stateless Design
- Initial web: simple text, images, links to other text/images
- Forms allowed information submission but system was stateless
- Neither browser nor server tracked users between pages
- Server forgot about users after each request - couldn't distinguish users on same network
- Reliable + personalized functionality was impossible
Cookie Invention & Implementation (1994)
- Lou Montouli at Netscape created cookies, adapting "magic cookies" computer science technique
- Other browsers adopted cookies, became part of web standards
- Cookie functionality:
- Client-side storage - server sends page + small text file (cookie)
- Browser saves cookie, sends with every subsequent request to same server
- Could store preferences (dark mode settings)
- Could last years even after browser/computer restarts
- Used for authentication - long random character strings acting as passwords
Privacy Rule & Third-Party Cookie Loophole
- Original privacy rule: Only site that sets cookie can read it back
- Loophole: Web pages could include material from other servers
- Images from elsewhere
- Scripting code
- Entire websites in frames
- Other servers could set/read their own cookies = "third-party cookies"
Advertiser Tracking & Profile Building
- Advertising companies set cookies tracking people across entire web
- Same ad company partnering with multiple websites built detailed profiles
- Profile building process:
- Track visits: hometown website → college website → specific medical condition website → online shop
- Combine shop details with cookie data
- Add name/address to profile
- Facebook share buttons reported back user browsing patterns
- Result: targeted ads on seemingly unconnected sites
Regulatory Response - EU Cookie Law
- EU acted first with "cookie law" (euphemistic name)
- Required consent to place cookies in all EU member countries
- Poorly implemented - confusing consent boxes
- Most people clicked "OK" to access content
- Browser makers began offering third-party cookie blocking options
Advertiser Adaptation - Fingerprinting
- Shifted from cookies to fingerprinting techniques
- Tracked users through:
- Installed fonts
- Monitor size
- Previously visited websites
- Individual computer setup quirks
- Web page rendering characteristics
- Individual elements appeared innocent but together uniquely identified users
Browser vs Advertiser Privacy War
- "Odd war" between browser makers and advertisers
- Sometimes "civil war" - same company owning popular browser and major advertising business
GDPR Implementation & Stronger Requirements
- General Data Protection Regulation applied stronger rules
- Requirements:
- No tracking without consent for EU citizens
- Full user knowledge of what they're signing up for
- Applied even to non-EU companies storing EU citizen data
- Penalties: 4% of global annual revenue OR €20 million (whichever higher)
- EU could block non-compliant companies from European business
Advertiser Response Options
- Option 1: Stop tracking people
- Option 2: Add consent boxes on each page
- Legal requirement: easy opt-out, simple one-click process
- Reality: Often not true - complex opt-out processes
Web Design Freedom vs Abuse
- Web built around freedom of design - fundamental principle
- Programmers pushed limits for decades
- Example: Entire Windows 95 virtual machine running in web browser
- Abuse potential:
- Newsletter signup interruptions
- Cryptocurrency mining in background
- Pop-up boxes and intrusive elements
Browser Reader Mode Response
- Most browsers now offer "article view" or "reader mode"
- Strips out adverts, pop-ups, design elements
- Shows only main content text
- Closer to Berners-Lee's original vision
- Trade-off: Loses creativity and design freedom web allows
Ongoing Technical Arms Race
- Techniques exist to detect and defeat reader view
- Force users to see adverts/newsletter pop-ups
- Every design freedom for creativity = freedom for abuse
- Pattern applies beyond web to entire online world
