AI summary by TwinMind

Google Exec on How Android AI Plans to Beat Apple’s iPhone | WSJ

The Wall Street Journal

10m 0s

AI Integration in Android and Pixel Phones

  • Google moving AI forward rapidly, integrating latest AI technologies
  • Gemini as most important AI technology for big evolution of assistant capability
  • Rick Osterloh oversees Google's Android, Chrome, and Hardware products
  • Tuesday announcement: 4 new Pixel phones with Gemini Live and AI features
  • Gemini Live available on all Android phones, not just Pixels

Gemini Live Voice Assistant Capabilities

  • Definition of AI phones: led by AI technologies, interact primarily through AI conversation
  • Gemini Live replacing Google Assistant on new Pixels
  • Key technical improvements:
    • System performance optimization
    • Low latency for quick dialogue
    • Natural conversation feel
    • Interruption capability during conversations
  • Current limitations:
    • Cannot set alarms/timers yet
    • Some knowledge gaps (confused Rick Osterloh with Rick Springfield)

Competitive Landscape

  • Apple Siri and OpenAI ChatGPT developing similar advanced voice capabilities
  • Gemini Live available now for Android users with Gemini app and Gemini Advanced subscription
  • Available on new Pixel phones: Pixel 9 Pro, Pixel 9 Pro Fold, upcoming Pixelbuds Pro 2
  • Pixelbuds Pro 2 design: small, wearable all day, great battery life, instant activation

AI Photo Manipulation Features

  • "Add Me" feature: uses augmented reality to scan area, take photos separately, stitch people together
  • Osterloh's perspective: doesn't change reality, provides editing tools like Photoshop
  • Acknowledges complicated world where photo authenticity questioned, especially on social media
  • Goal: serve users and provide tools they want

Call Notes Feature (Pixel-only)

  • AI transcribes and summarizes phone calls
  • Processing happens on-device using Tensor G4 chip
  • Demo showed mixed accuracy: captured trip dates correctly but misinterpreted joke details
  • Hot dog joke became "Hot Pocket" in summary

Data Privacy and Training

  • Personal data NOT used to train Gemini and other Google LLMs
  • Only using information users explicitly gave permission to train on
  • Public web data used for training
  • Phone calls, emails, calendar appointments, text messages NOT used for training

Competitive Advantages Over Apple

  • Google's unique position: trusted provider with personal information + web information
  • Can understand calendar information combined with real-world data (travel times to appointments)
  • Apple allowing LLM choice starting with ChatGPT/OpenAI
  • Google wants Gemini everywhere, working on iOS and other platform solutions

Market Position and Strategy

  • Pixel phones have only 3% US smartphone market share, <1% globally
  • Osterloh sees no doubt about resource investment despite small market share
  • Pixel phones represent Google's full AI research capabilities brought to users
  • Platform building strategy through hardware

Future AR/VR Technology

  • Google showing AI glasses at May developers conference
  • AI can see world and answer questions - "Google Glass but cool and useful"
  • Google never stopped working on glasses technology
  • Waiting until technology is "just right"
  • Timeline: "sometime in next few years" for market release

Marketing Challenges and Lessons

  • Olympics Gemini ad controversy: father using AI to help daughter write letter to Sydney McLaughlin-Hurdle
  • Google pulled ad after backlash about AI replacing personal relationships
  • Osterloh acknowledges "missed the mark" with ad
  • Comparison to evolution from handwritten thank you notes to emails
  • Belief that people will adopt technologies that increase productivity and connection
  • Market not fully ready to embrace all AI changes yet

TwinMind

Get summaries like this for your own meetings

TwinMind takes notes in the background during meetings, lectures, and calls, then writes the summary for you.

Free plan to get started

No bot joins your calls

Phone, desktop & Chrome apps

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome

Your next meeting, summarized like this

TwinMind listens in the background and turns meetings, lectures, and calls into searchable notes you can chat with. Start free.

Available on phone, desktop & Chrome