AI summary by TwinMind

Simulating Rolling Shutter (Behind the Scenes) - Smarter Every Day

Smarter Every Day 2

8m 49s

Rolling Shutter Simulation Setup

  • Creator left Australia with high-speed footage needing rolling shutter simulation
  • Met friend Henry at Patreon headquarters for After Effects expertise
  • Original footage: high-speed video without rolling shutter effects
  • Slowed down footage by factor of 10 for simulation base

Technical Implementation Process

  • Used additive image technique with temporal pixel mapping
    • Top line of pixels from frame 1
    • Next line down from frame 2
    • Continued pattern: each pixel line = next frame in sequence
    • ~1000 pixels height = 1000 different frames over time
  • Gradient composition controls temporal sampling
    • Early time = one end, late time = other end
    • Tells computer how to offset each pixel line by different time amounts
  • Rotated gradient 90 degrees to change rolling shutter direction
    • Vertical gradient = top-to-bottom rolling shutter
    • Horizontal gradient = left-to-right rolling shutter

Bit Depth Requirements

  • Must work in 16-bit or greater color space
  • 8-bit images only have 255 brightness values
  • Need more than 255 pixels from top to bottom
  • After Effects default 16-bit allows proper simulation
  • 8-bit produces weird artifacts

Rolling Shutter Direction Effects

  • Vertical phone orientation: rolling shutter goes down screen
  • Horizontal orientation: rolling shutter goes left-to-right
  • Horizontal creates "mustache" distortion effects
  • Adjustable timing parameters:
    • Changed from ~20 milliseconds to 40 milliseconds scan time
    • Longer scan time = more propeller rotation = more separation artifacts

Propeller Blade Analysis

  • Each visible segment represents one blade passing through
  • Two blades per propeller = two segments per full rotation
  • Multiple rotations during scan create separated artifacts
  • Pattern shows sinusoidal interaction (rotational mode) with linear wipe
  • Resembles arc tangent graph family of trigonometric curves

Practical Applications

  • Can calculate RPMs from rolling shutter artifacts
    • Count propeller segments on one side
    • Know rolling shutter sample rate
    • Get ballpark RPM estimates from iPhone footage
  • Demonstrates real-world rolling shutter physics through simulation

TwinMind

Get summaries like this for your own meetings

TwinMind takes notes in the background during meetings, lectures, and calls, then writes the summary for you.

Free plan to get started

No bot joins your calls

Phone, desktop & Chrome apps

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome