AI summary by TwinMind

A Powerful New Neurotech Tool for Augmenting Your Mind | Conor Russomanno | TED

TED

13m 0s

Personal Journey and Motivation

  • Conor Russomanno became obsessed with brain-mind relationship after suffering concussions playing football/rugby in college
  • Felt mind changed for years after - studying computers, felt like damaged hardware running different software
  • Close friend suffered serious neck injury, multiple friends/family struggling with mental health issues
  • People loved dearly afflicted by nervous system/mind ailments
  • Pursuing MFA in Design and Technology at Parsons when friend showed open-source tutorial for low-cost single-channel EEG system
  • After long nights hacking/tinkering, saw brainwaves dancing across screen for first time - life-changing moment
  • Felt possibility to help himself and loved ones, realized couldn't do it alone

OpenBCI Company Foundation and Evolution

  • Started OpenBCI in 2013 in Brooklyn with like-minded friends - open-source neurotechnology company
  • Initial goal: build inward-pointing telescope, share blueprints globally so anyone with computer could peer into own brain
  • Initially EEG-only company selling brain sensors to measure brain activity
  • Discovered users doing strange things with technology:
    • Connecting equipment to stomach to measure gut neurons, study gut-brain connection/microbiome
    • Building muscle sensors/controllers for prosthetics/robotics
    • Designing new devices/peripheral add-ons for measuring new data types

Key Insights About Brain vs Mind

  • Brain by itself quite boring - brain data alone lacks context
  • Ultimate care: mind, consciousness, human cognition (not just brain)
  • Context sensors make brain data more useful:
    • EMG sensors (muscle activity)
    • ECG sensors (heart activity)
    • Eye trackers
    • Environmental sensors (world around us)
  • Body organs/sensory receptors easier to collect data from than brain
  • Arguably more important for determining emotions, intentions, mind overall
  • People interested in modulating mind through sensory stimulation: light, sound, haptics, electricity
  • Recording mind vs modulating it - different capabilities

Closed-Loop Systems and Future Vision

  • Combined system reading from and writing to brain/body = closed-loop system/bidirectional human interface
  • Concept truly profound - will define next major revolution in computing technology
  • Products designed to adapt to user (not just average user) = truly special
  • Knowing emotion/feeling data patterns + how to make data go up/down
  • Using AI to build constructive/destructive interference patterns to amplify/suppress emotions/feelings
  • Near future: computers resonantly/subconsciously connected to users
  • Enabling empathetic computing for first time

Galea Development

  • 2018: Put learnings to work, began development of new cognitive exploration tool
  • Named after friend Gael who passed from ALS in 2016
  • Galea: multimodal bio-sensing headset packed with sensors
  • Measures: heart, skin, muscles, eyes, brain
  • Combines capability with head-mounted displays/AR/VR headsets
  • Exploring integration of non-invasive electrical neural stimulation
  • Software suite turns raw sensor data into meaningful metrics
  • Real-time interactivity/control with some sensors
  • Quantifiable inferences about high-level mind states: stress, fatigue, cognitive workload, focus

Christian Bayerlein Collaboration

  • 2019: Christian Bayerlein (legendary neurohacker) reached out - early Kickstarter backer
  • Smart, intelligent, happy-go-lucky, easygoing person
  • Asked to connect to sensors - "I thought you would never ask"
  • 20 minutes setup with electrodes - provided 4 new computer inputs (digital buttons, voluntary control)
  • Essentially doubled his computer inputs
  • COVID setbacks delayed progress
  • Flew to Germany to work with Christian in person for first prototype
  • Christian spent months training with prototype
  • Sent data across Atlantic from Germany to Brooklyn
  • Flew virtual drone in their offices

Technical Implementation Process

  • Scoured Christian's body for residual motor function
  • Connected electrodes to 4 muscles with most voluntary control
  • Turned muscles into digital buttons
  • Applied smart filtering/signal processing to adapt buttons into sliders/digital potentiometer
  • Turned 4 sliders into virtual joystick
  • Combined new joystick with lip-controlled wheelchair joystick
  • Two joysticks combined gave Christian control over all manual drone controls

Live Demonstration

  • Asked audience to turn off Bluetooth, put phones in airplane mode (safety)
  • Heads-up display showing Christian's biometric data + drone information
  • Left side showed Christian's muscle data
  • Christian successfully flew drone over audience
  • Audience called out commands (straight forward, up)
  • Christian demonstrated autonomous control
  • Conor took control to prove no backstage operator
  • Christian joked he was better pilot than Conor

Technical Implications and Future Applications

  • Christian repurposed dormant muscles for extended/augmented interactivity
  • Muscles turned into generic controller (mapped to drone, applicable to anything)
  • Even non-disabled individuals have dozens of dormant muscles for augmented control
  • All virtual joystick code will be open-sourced for implementation/improvement

Key Takeaways

  • Cannot conflate brain with mind - need data from all over body to understand emotions/intentions/mind
  • Open-source technology access/literacy combats potential ethical challenges in neural technology
  • Must set up guardrails, design desired future
  • Courage/resilience of trailblazers like Christian who prove impossible is possible

Christian's Message

  • Born with genetic condition affecting mobility, requires assistance
  • Despite disability: happy, fulfilled person
  • Physical limitations not main barrier - environmental barriers are
  • Tech nerd and political activist
  • Believes technology can empower disabled people
  • Create better, more inclusive, accessible world for everyone
  • Demonstration shows cutting-edge technology + human curiosity/creativity potential
  • Build tools that empower people, applications breaking down barriers, systems unlocking possibilities

TwinMind

Get summaries like this for your own meetings

TwinMind takes notes in the background during meetings, lectures, and calls, then writes the summary for you.

Free plan to get started

No bot joins your calls

Phone, desktop & Chrome apps

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome