AI summary by TwinMind
A Powerful New Neurotech Tool for Augmenting Your Mind | Conor Russomanno | TED
TED
13m 0s
Personal Journey and Motivation
- Conor Russomanno became obsessed with brain-mind relationship after suffering concussions playing football/rugby in college
- Felt mind changed for years after - studying computers, felt like damaged hardware running different software
- Close friend suffered serious neck injury, multiple friends/family struggling with mental health issues
- People loved dearly afflicted by nervous system/mind ailments
- Pursuing MFA in Design and Technology at Parsons when friend showed open-source tutorial for low-cost single-channel EEG system
- After long nights hacking/tinkering, saw brainwaves dancing across screen for first time - life-changing moment
- Felt possibility to help himself and loved ones, realized couldn't do it alone
OpenBCI Company Foundation and Evolution
- Started OpenBCI in 2013 in Brooklyn with like-minded friends - open-source neurotechnology company
- Initial goal: build inward-pointing telescope, share blueprints globally so anyone with computer could peer into own brain
- Initially EEG-only company selling brain sensors to measure brain activity
- Discovered users doing strange things with technology:
- Connecting equipment to stomach to measure gut neurons, study gut-brain connection/microbiome
- Building muscle sensors/controllers for prosthetics/robotics
- Designing new devices/peripheral add-ons for measuring new data types
Key Insights About Brain vs Mind
- Brain by itself quite boring - brain data alone lacks context
- Ultimate care: mind, consciousness, human cognition (not just brain)
- Context sensors make brain data more useful:
- EMG sensors (muscle activity)
- ECG sensors (heart activity)
- Eye trackers
- Environmental sensors (world around us)
- Body organs/sensory receptors easier to collect data from than brain
- Arguably more important for determining emotions, intentions, mind overall
- People interested in modulating mind through sensory stimulation: light, sound, haptics, electricity
- Recording mind vs modulating it - different capabilities
Closed-Loop Systems and Future Vision
- Combined system reading from and writing to brain/body = closed-loop system/bidirectional human interface
- Concept truly profound - will define next major revolution in computing technology
- Products designed to adapt to user (not just average user) = truly special
- Knowing emotion/feeling data patterns + how to make data go up/down
- Using AI to build constructive/destructive interference patterns to amplify/suppress emotions/feelings
- Near future: computers resonantly/subconsciously connected to users
- Enabling empathetic computing for first time
Galea Development
- 2018: Put learnings to work, began development of new cognitive exploration tool
- Named after friend Gael who passed from ALS in 2016
- Galea: multimodal bio-sensing headset packed with sensors
- Measures: heart, skin, muscles, eyes, brain
- Combines capability with head-mounted displays/AR/VR headsets
- Exploring integration of non-invasive electrical neural stimulation
- Software suite turns raw sensor data into meaningful metrics
- Real-time interactivity/control with some sensors
- Quantifiable inferences about high-level mind states: stress, fatigue, cognitive workload, focus
Christian Bayerlein Collaboration
- 2019: Christian Bayerlein (legendary neurohacker) reached out - early Kickstarter backer
- Smart, intelligent, happy-go-lucky, easygoing person
- Asked to connect to sensors - "I thought you would never ask"
- 20 minutes setup with electrodes - provided 4 new computer inputs (digital buttons, voluntary control)
- Essentially doubled his computer inputs
- COVID setbacks delayed progress
- Flew to Germany to work with Christian in person for first prototype
- Christian spent months training with prototype
- Sent data across Atlantic from Germany to Brooklyn
- Flew virtual drone in their offices
Technical Implementation Process
- Scoured Christian's body for residual motor function
- Connected electrodes to 4 muscles with most voluntary control
- Turned muscles into digital buttons
- Applied smart filtering/signal processing to adapt buttons into sliders/digital potentiometer
- Turned 4 sliders into virtual joystick
- Combined new joystick with lip-controlled wheelchair joystick
- Two joysticks combined gave Christian control over all manual drone controls
Live Demonstration
- Asked audience to turn off Bluetooth, put phones in airplane mode (safety)
- Heads-up display showing Christian's biometric data + drone information
- Left side showed Christian's muscle data
- Christian successfully flew drone over audience
- Audience called out commands (straight forward, up)
- Christian demonstrated autonomous control
- Conor took control to prove no backstage operator
- Christian joked he was better pilot than Conor
Technical Implications and Future Applications
- Christian repurposed dormant muscles for extended/augmented interactivity
- Muscles turned into generic controller (mapped to drone, applicable to anything)
- Even non-disabled individuals have dozens of dormant muscles for augmented control
- All virtual joystick code will be open-sourced for implementation/improvement
Key Takeaways
- Cannot conflate brain with mind - need data from all over body to understand emotions/intentions/mind
- Open-source technology access/literacy combats potential ethical challenges in neural technology
- Must set up guardrails, design desired future
- Courage/resilience of trailblazers like Christian who prove impossible is possible
Christian's Message
- Born with genetic condition affecting mobility, requires assistance
- Despite disability: happy, fulfilled person
- Physical limitations not main barrier - environmental barriers are
- Tech nerd and political activist
- Believes technology can empower disabled people
- Create better, more inclusive, accessible world for everyone
- Demonstration shows cutting-edge technology + human curiosity/creativity potential
- Build tools that empower people, applications breaking down barriers, systems unlocking possibilities
