AI summary by TwinMind
6. Perceiving: Interpreting the Information (audio only)
MIT OpenCourseWare
1h 19m 32s
Course Introduction and McCullough Effect Follow-up
- MIT OpenCourseWare lecture continuation from previous session
- McCullough effect still visible in some students when tilting heads
- Suggestion to post PowerPoint online for students to build own McCullough effects
Visual System Processing Overview
- Early visual system processes detect basic features (lines, dots, movement)
- Too much information coming in - attention bottleneck filters information
- Perception results from many inferences/guesses about world nature
- Key problems: 3D world → 2D retinal input, light intensities → surface properties, stable world from unstable vantage point
Eye Movement Compensation Mechanisms
- Demonstration: looking at different corners of McCullough pattern doesn't make it jump
- Brain sends copy of eye movement command to visual centers
- Two functions: ignore smear during movement, compensate for displacement
- Finger-poking eye experiment shows world jumps without compensation signal
- Vestibular-ocular reflex: eyes counter-rotate when head moves
- Head movement vs finger tracking demonstration shows different processing speeds
Perceptual Inference and Grouping
- Dalmatian dog image demonstrates inference process slowed down enough to feel
- Visual system decides which elements "go together" using grouping rules
- Gestalt grouping principles developed early 20th century
Good Continuation Rule
- Line segments group together if deviation <30 degrees from collinear
- Demonstration with rotating line segments showing grouping changes
- Junction processing: "three roads diverged" - system chooses most likely continuation path
Occlusion and Subjective Contours
- Curvy line behind occluder demonstration
- Rules: smooth curve connections work better than inflected curves
- Subjective contours appear where no physical contour exists
- Simultaneous contrast bar demonstration - same gray appears different based on surroundings
Proximity and Similarity Rules
- Dot array voting demonstrations
- Proximity: closer elements group together
- Similarity can override proximity (color grouping vs spatial grouping)
- Multiple rules operate simultaneously, can be balanced against each other
Edge Detection and Surface Properties
- Early visual cortex looks at small bits, must tie together larger structures
- Real world contours disappear due to occlusion or image problems
- Photoshop edge detection produces fragmented results requiring grouping
Simultaneous Contrast and Lighting
- Gray bar demonstration with gradient background
- Visual system separates surface properties from illumination
- Abrupt changes = edges, gradual changes = lighting variations
- Craig-O'Brien-Cornsweet illusion: uniform gray appears different due to edge processing
Adelson's Checker Shadow Illusion
- Squares A and B identical gray levels despite appearing different
- Virtual cylinder casting virtual shadow
- Brain discounts shadow, infers checkerboard pattern
- Demonstrates sophisticated illumination processing
Shadow Processing and Shape Recognition
- "COW" shadow demonstration - black regions interpreted as shadows
- Brain infers 3D letter shapes from shadow patterns
- Assumes light from upper left, calculates object shapes producing shadows
- Mooney faces: black/white regions interpreted as faces through shadow assumptions
- Shadow direction critical: inverted contrast destroys face perception
3D Depth Perception Cues
Occlusion
- Circle, square, triangle demonstration
- Solid objects occlude each other - automatic depth ordering assumption
- Alternative interpretations (holes in screen) seem unlikely
Relative Size and Familiar Size
- Bunny size demonstrations
- Assume objects are roughly same size in world
- Larger retinal image = closer object
- People example: front row vs back row head sizes
- Texture gradient: organized size changes create depth plane impression
Atmospheric Perspective
- Distant objects hazier and bluer due to light scattering
- Geographic variation: doesn't work well in dry climates (Arizona example)
- 50-mile distance misjudgment due to clear air
Linear Perspective
- Parallel lines converge to vanishing point
- Known implicitly by animals, made explicit in Renaissance art
- Ponzo illusion: identical lines appear different sizes in perspective context
- Train tracks analogy for size constancy effects
Escher Demonstrations
- Multiple conflicting vanishing points in single image
- Local perspective calculations vs global inconsistency
- Impossible structures work because attention processes locally
Necker Cube Demonstrations
- Wire frame cube vertices create cube perception
- Bi-stable figure: two possible cube orientations
- Subjective contours visible in black regions
- Depth interpretation affects contour visibility
- Behind/in-front interpretations change subjective contour strength
- Limited hypothesis set: difficult to see as 8 discs with Y-shapes
Renaissance Art and Inconsistent Lighting
- Multiple light sources in single outdoor scene
- Local shadow processing vs global illumination consistency
- Brain accepts inconsistent physics locally while using shadow information
Binocular and Motion Cues
- Stereopsis: different images in two eyes provide depth information
- Magic Eye posters exploit binocular disparity
- Monocular vision still provides substantial depth information
- Tree branch experiment: stereo most useful for complex overlapping structures
Motion Parallax
- Head movement creates systematic image changes
- Closer objects move more than distant objects on retina
- Tree experiment with head movement vs eye opening
Convergence
- Eyes point at objects at different angles for different distances
- Finger approach demonstration
- Chameleon research: prism glasses disrupt fly-catching
- Chickens don't adapt to prism displacement, humans do
Cross-Modal Integration and Motion Sickness
- Multiple senses provide information for world interpretation
- Movie example: sound appears to come from screen despite side speakers
Motion Sickness Mechanism
- Vestibular system: fluid-filled tubes with hair cells detect head rotation
- Spinning demonstration: fluid lag creates opposite rotation sensation after stopping
- Alcohol affects fluid calibration, causes dizziness
Visual-Vestibular Mismatch
- Reading on bus: stable visual input vs moving vestibular input
- Airplane turbulence: no visual motion but vestibular motion detected
- Evolutionary inference: sensory mismatch indicates poisoning
- Vomiting response evolved as neurotoxin protection
- Modern transportation creates unnatural sensory conflicts
