AI summary by TwinMind

AI Interfaces Of The Future | Design Review

Y Combinator

36m 28s

Introduction & Context Setting

  • Rafael Shad (Notion Calendar creator) joins to review cutting-edge AI interfaces
  • Focus: New AI UIs emerging beyond common chat interfaces over next decade
  • Key insight: Traditional software = nouns (buttons, forms, dropdowns), AI software = verbs (workflows, auto-complete, gather information)
  • Challenge: Don't have tooling yet to "draw verbs on screen"

Voice AI Interfaces

Vapi - Voice AI for Developers

  • Product: Build, test, deploy voice agents in minutes vs months
  • Target: Developer-focused implementation tool
  • Key Issues Identified:
    • No visual feedback when speaking/listening (microphone recognition unclear)
    • No visual indication when AI responding
    • Important: Pair multimodal cues, don't rely solely on voice
  • Interruption Test:
    • AI didn't pause during interruption
    • Missed user question entirely when finished with own agenda
  • Standout Feature:
    • Shows milliseconds delay for each response
    • Builds intuition for natural conversation latency
    • Latency = interface itself (longer = more robotic feeling)
  • Voice Quality: Very human-like, previously required huge company resources

Retail AI - Call Operations Voice AI

  • Product: Supercharge call operations with voice AI
  • Live Demo: Debt collection scenario ($800 outstanding balance)
  • Adaptation Test: Successfully adjusted when told "this is Steve, not Aaron"
  • Limitations:
    • High latency breaks human illusion
    • Shut down conversation instead of following contextual cues
    • Room for improvement in conversational flow
  • Use Case: First line defense, escalate 50% to humans with transcript/context
  • Backend Potential: Rich UI showing call summaries to human operators

AI Agents & Workflow Visualization

Gum Loop - AI Automation Platform

  • Product: 10x output with AI automation, no coding required
  • Interface: Canvas-based workflow visualization
  • Template: YC directory web scraping workflow
  • Design Elements:
    • Open-ended pannable/zoomable canvas
    • Color-coded boxes for different step types (input, actions, output)
    • Linear workflow: Input → Combine Text → Web Scraper → Output
  • Improvement Suggestions:
    • Add color legend for box types
    • Different zoom levels showing different fidelity
    • Hide small text when zoomed out, collapse to colored blocks
    • Showcase multi-dimensional/branching workflows vs linear examples
  • Canvas Pattern: Emerging as new document type for AI process modeling
  • Historical Context: Similar to flowcharts used by chip designers 50+ years ago

Answer Grid - Answers at Scale

  • Product: Agent-powered data research and compilation
  • Interface Pattern: Free-form text box with suggested prompts as buttons
  • Demo: "AI companies in San Francisco" → structured spreadsheet output
  • Key Features:
    • Each spreadsheet cell gets own AI agent
    • Add custom columns dynamically (funding raised, employees)
    • Sources/citations for each data point (click to verify)
    • Web scraping and data assembly behind scenes
  • Trust & Verification:
    • Inline source citations (similar to Perplexity pattern)
    • Click each cell to see source websites
    • Addresses AI hallucination concerns
    • Academic paper footnote pattern applied to software

Prompt-to-Output Interfaces

Polyat - AI Product Designer

  • Product: Design and iterate faster with AI, get production-ready code
  • Input: Multimodal (text, voice, image upload for sketches)
  • Demo: "Treasury management dashboard with floating sidebar, glass morphic, dark orange gradient"
  • Loading Experience:
    • Animated messages ("assembling pixels with tweezers")
    • Unclear duration (10 seconds vs 10 minutes?)
    • Suggestion: Show technical log for developer audience
  • Output Quality: Generated interactive design with hover states
  • Iteration Capability:
    • Edit individual elements
    • "Make sidebar blue" → incremental changes
    • Challenge: Preserve existing design while making targeted changes
  • Prompt Complexity:
    • Free-form allows anything (glass morphic terms)
    • Risk: User doesn't know if AI understands specific terms
    • Suggestion: Visual prompt builder with design term "pills"
    • Need feedback on which prompt parts AI executed vs ignored

Adaptive AI Interfaces

Zuni - Smarter Email App for Founders

  • Product: Email responses based on content analysis
  • Interface: Email content determines available response buttons
  • Demo: Missed call email → "Confirm call time", "Dismiss", other options
  • Interaction Design:
    • Single-letter keyboard shortcuts (Y for yes)
    • Custom UI for each response type
    • Context-aware input fields (time picker for scheduling)
  • Abstraction Levels:
    • Current: Process each email faster
    • Higher: Full autopilot email management
    • Lower: More autocomplete features
  • Consistency Challenge:
    • Buttons change per email but keyboard shortcuts stay same
    • Hot keys without modifier keys risk accidental activation
    • Need clear focus state indication

Video Generation Interfaces

Argil - AI Video Studio

  • Product: Production quality videos with deepfake technology
  • Training: Few minutes of video to create deepfake model
  • Interface:
    • Text script input with camera angle blocks
    • Manual body language/gesture selection
    • Hover previews of gesture options
  • Two-Phase Generation:
    • Phase 1: Fast audio + blurred video preview
    • Phase 2: Full video generation (12+ minutes)
  • Design Strategy: Trade fidelity for immediacy
  • Human-in-Loop: Iterate on script quickly before full generation
  • Output Quality: Realistic voice, lip sync, expressions, camera cuts

Key Takeaways & Future Trends

  • Evolution: From chat boxes to explosion of AI-native interface components
  • Modalities: Voice, visual workflows, adaptive UIs, video generation
  • Core Challenge: Keep users in control while AI executes autonomously
  • Historical Parallel: Similar to 2010 touch device revolution requiring software reinvention
  • Latency: Critical factor in perceived naturalness of AI interactions
  • Verification: Source citations and feedback loops essential for trust
  • Canvas Interfaces: Emerging standard for complex AI workflow control

TwinMind

Get summaries like this for your own meetings

TwinMind takes notes in the background during meetings, lectures, and calls, then writes the summary for you.

Free plan to get started

No bot joins your calls

Phone, desktop & Chrome apps

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome