AI summary by TwinMind
Simulating Rolling Shutter (Behind the Scenes) - Smarter Every Day
Smarter Every Day 2
8m 49s
Rolling Shutter Simulation Setup
- Creator left Australia with high-speed footage needing rolling shutter simulation
- Met friend Henry at Patreon headquarters for After Effects expertise
- Original footage: high-speed video without rolling shutter effects
- Slowed down footage by factor of 10 for simulation base
Technical Implementation Process
- Used additive image technique with temporal pixel mapping
- Top line of pixels from frame 1
- Next line down from frame 2
- Continued pattern: each pixel line = next frame in sequence
- ~1000 pixels height = 1000 different frames over time
- Gradient composition controls temporal sampling
- Early time = one end, late time = other end
- Tells computer how to offset each pixel line by different time amounts
- Rotated gradient 90 degrees to change rolling shutter direction
- Vertical gradient = top-to-bottom rolling shutter
- Horizontal gradient = left-to-right rolling shutter
Bit Depth Requirements
- Must work in 16-bit or greater color space
- 8-bit images only have 255 brightness values
- Need more than 255 pixels from top to bottom
- After Effects default 16-bit allows proper simulation
- 8-bit produces weird artifacts
Rolling Shutter Direction Effects
- Vertical phone orientation: rolling shutter goes down screen
- Horizontal orientation: rolling shutter goes left-to-right
- Horizontal creates "mustache" distortion effects
- Adjustable timing parameters:
- Changed from ~20 milliseconds to 40 milliseconds scan time
- Longer scan time = more propeller rotation = more separation artifacts
Propeller Blade Analysis
- Each visible segment represents one blade passing through
- Two blades per propeller = two segments per full rotation
- Multiple rotations during scan create separated artifacts
- Pattern shows sinusoidal interaction (rotational mode) with linear wipe
- Resembles arc tangent graph family of trigonometric curves
Practical Applications
- Can calculate RPMs from rolling shutter artifacts
- Count propeller segments on one side
- Know rolling shutter sample rate
- Get ballpark RPM estimates from iPhone footage
- Demonstrates real-world rolling shutter physics through simulation
