AnalysisTutorial / explainerSpeech & Audio · Agents & Tool Use1 source · Oct 11, 2026

Can Your Agent Hear You Now? Building Live Voice Agents with Gemini — Thor Schaeff

An agent that hears you, sees you, and answers in your language, in real time.

Proof1 independent outlet

Key points

  • Here's how to build one with Gemini.
  • Thor Schaeff, who works on developer experience at Google DeepMind, runs a set of live demos of Gemini's real-time and media models.
  • He explains how the Live API works: a stateful WebSocket session that takes in text, audio and video and streams back audio plus a transcript, using a native audio model rather than a speech-to-text and text-to-speech pipeline.
  • • Near real-time speech translation with Gemini 3.5 Live Translate

Sources (1)

Extractive summary: sentences quoted from the sources.

Before this

  1. Oct 11, 2026Agents That Own Their Inference — Du'an Lightfoot & Khaja Omer, Akamai Technologies
  2. Oct 10, 2026What Drives AI Citations? Content, Retrieval and Model Knowledge in Generative Engine Optimization (GEO)
  3. Oct 9, 2026APEX-Harm: Evaluating Agent Safety in Shared Professional Workspaces
  4. Oct 9, 2026Harness^2: Recursive Agent Harnessing for an Open World
  5. Oct 8, 2026People Making Conversation: Evaluating How Naturally Speech Models Converse
  6. Oct 8, 2026From Reactive Containment to Proactive Assurance: Lessons from OpenAI, Anthropic, and Google Agent Security Incidents

Related