AI summary by TwinMind

6. Perceiving: Interpreting the Information (audio only)

MIT OpenCourseWare

1h 19m 32s

Course Introduction and McCullough Effect Follow-up

  • MIT OpenCourseWare lecture continuation from previous session
  • McCullough effect still visible in some students when tilting heads
  • Suggestion to post PowerPoint online for students to build own McCullough effects

Visual System Processing Overview

  • Early visual system processes detect basic features (lines, dots, movement)
  • Too much information coming in - attention bottleneck filters information
  • Perception results from many inferences/guesses about world nature
  • Key problems: 3D world → 2D retinal input, light intensities → surface properties, stable world from unstable vantage point

Eye Movement Compensation Mechanisms

  • Demonstration: looking at different corners of McCullough pattern doesn't make it jump
  • Brain sends copy of eye movement command to visual centers
  • Two functions: ignore smear during movement, compensate for displacement
  • Finger-poking eye experiment shows world jumps without compensation signal
  • Vestibular-ocular reflex: eyes counter-rotate when head moves
  • Head movement vs finger tracking demonstration shows different processing speeds

Perceptual Inference and Grouping

  • Dalmatian dog image demonstrates inference process slowed down enough to feel
  • Visual system decides which elements "go together" using grouping rules
  • Gestalt grouping principles developed early 20th century

Good Continuation Rule

  • Line segments group together if deviation <30 degrees from collinear
  • Demonstration with rotating line segments showing grouping changes
  • Junction processing: "three roads diverged" - system chooses most likely continuation path

Occlusion and Subjective Contours

  • Curvy line behind occluder demonstration
  • Rules: smooth curve connections work better than inflected curves
  • Subjective contours appear where no physical contour exists
  • Simultaneous contrast bar demonstration - same gray appears different based on surroundings

Proximity and Similarity Rules

  • Dot array voting demonstrations
  • Proximity: closer elements group together
  • Similarity can override proximity (color grouping vs spatial grouping)
  • Multiple rules operate simultaneously, can be balanced against each other

Edge Detection and Surface Properties

  • Early visual cortex looks at small bits, must tie together larger structures
  • Real world contours disappear due to occlusion or image problems
  • Photoshop edge detection produces fragmented results requiring grouping

Simultaneous Contrast and Lighting

  • Gray bar demonstration with gradient background
  • Visual system separates surface properties from illumination
  • Abrupt changes = edges, gradual changes = lighting variations
  • Craig-O'Brien-Cornsweet illusion: uniform gray appears different due to edge processing

Adelson's Checker Shadow Illusion

  • Squares A and B identical gray levels despite appearing different
  • Virtual cylinder casting virtual shadow
  • Brain discounts shadow, infers checkerboard pattern
  • Demonstrates sophisticated illumination processing

Shadow Processing and Shape Recognition

  • "COW" shadow demonstration - black regions interpreted as shadows
  • Brain infers 3D letter shapes from shadow patterns
  • Assumes light from upper left, calculates object shapes producing shadows
  • Mooney faces: black/white regions interpreted as faces through shadow assumptions
  • Shadow direction critical: inverted contrast destroys face perception

3D Depth Perception Cues

Occlusion

  • Circle, square, triangle demonstration
  • Solid objects occlude each other - automatic depth ordering assumption
  • Alternative interpretations (holes in screen) seem unlikely

Relative Size and Familiar Size

  • Bunny size demonstrations
  • Assume objects are roughly same size in world
  • Larger retinal image = closer object
  • People example: front row vs back row head sizes
  • Texture gradient: organized size changes create depth plane impression

Atmospheric Perspective

  • Distant objects hazier and bluer due to light scattering
  • Geographic variation: doesn't work well in dry climates (Arizona example)
  • 50-mile distance misjudgment due to clear air

Linear Perspective

  • Parallel lines converge to vanishing point
  • Known implicitly by animals, made explicit in Renaissance art
  • Ponzo illusion: identical lines appear different sizes in perspective context
  • Train tracks analogy for size constancy effects

Escher Demonstrations

  • Multiple conflicting vanishing points in single image
  • Local perspective calculations vs global inconsistency
  • Impossible structures work because attention processes locally

Necker Cube Demonstrations

  • Wire frame cube vertices create cube perception
  • Bi-stable figure: two possible cube orientations
  • Subjective contours visible in black regions
  • Depth interpretation affects contour visibility
  • Behind/in-front interpretations change subjective contour strength
  • Limited hypothesis set: difficult to see as 8 discs with Y-shapes

Renaissance Art and Inconsistent Lighting

  • Multiple light sources in single outdoor scene
  • Local shadow processing vs global illumination consistency
  • Brain accepts inconsistent physics locally while using shadow information

Binocular and Motion Cues

  • Stereopsis: different images in two eyes provide depth information
  • Magic Eye posters exploit binocular disparity
  • Monocular vision still provides substantial depth information
  • Tree branch experiment: stereo most useful for complex overlapping structures

Motion Parallax

  • Head movement creates systematic image changes
  • Closer objects move more than distant objects on retina
  • Tree experiment with head movement vs eye opening

Convergence

  • Eyes point at objects at different angles for different distances
  • Finger approach demonstration
  • Chameleon research: prism glasses disrupt fly-catching
  • Chickens don't adapt to prism displacement, humans do

Cross-Modal Integration and Motion Sickness

  • Multiple senses provide information for world interpretation
  • Movie example: sound appears to come from screen despite side speakers

Motion Sickness Mechanism

  • Vestibular system: fluid-filled tubes with hair cells detect head rotation
  • Spinning demonstration: fluid lag creates opposite rotation sensation after stopping
  • Alcohol affects fluid calibration, causes dizziness

Visual-Vestibular Mismatch

  • Reading on bus: stable visual input vs moving vestibular input
  • Airplane turbulence: no visual motion but vestibular motion detected
  • Evolutionary inference: sensory mismatch indicates poisoning
  • Vomiting response evolved as neurotoxin protection
  • Modern transportation creates unnatural sensory conflicts

TwinMind

Get summaries like this for your own meetings

TwinMind takes notes in the background during meetings, lectures, and calls, then writes the summary for you.

Free plan to get started

No bot joins your calls

Phone, desktop & Chrome apps

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome