# Building AI Voice Agents with Scott Stephenson - #707

An episode of [The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)](https://invisiblenetwork.ai/podcast/1116303051), 28 Oct 2024, 1 h 02 min.

Audio: https://pscrb.fm/rss/p/traffic.megaphone.fm/MLN6815731992.mp3?updated=1730147923

Today, we're joined by Scott Stephenson, co-founder and CEO of Deepgram to discuss voice AI agents. We explore the importance of perception, understanding, and interaction and how these key components work together in building intelligent AI voice agents. We discuss the role of multimodal LLMs as well as speech-to-text and text-to-speech models in building AI voice agents, and dig into the benefits and limitations of text-based approaches to voice interactions. We dig into what’s required to deliver real-time voice interactions and the promise of closed-loop, continuously improving, federated learning agents. Finally, Scott shares practical applications of AI voice agents at Deepgram and provides an overview of their newly released agent toolkit. The complete show notes for this episode can be found at https://twimlai.com/go/707.

Shows are listed from Apple Podcasts' charts and directory, and Podcast Index where it is used. Every show and episode belongs to its publisher and plays from the publisher's own feed; this site hosts none of them.
