# SE Radio 610: Phillip Carter on Observability for Large Language Models

An episode of [Software Engineering Radio - the podcast for professional software developers](https://invisiblenetwork.ai/podcast/120906714), 3 Apr 2024, 1 h 05 min.

Audio: https://traffic.libsyn.com/secure/seradio/610-phillip_carter_observability_for_large_language_models.mp3?dest-id=23379

Phillip Carter, Principal Product Manager at Honeycomb and open source software developer, talks with host Giovanni Asproni about observability for large language models (LLMs). The episode explores similarities and differences for observability with LLMs versus more conventional systems. Key topics include: how observability helps in testing parts of LLMs that aren't amenable to automated unit or integration testing; using observability to develop and refine the functionality provided by the LLM (observability-driven development); using observability to debug LLMs; and the importance of incremental development and delivery for LLMs and how observability facilitates both. Phillip also offers suggestions on how to get started with implementing observability for LLMs, as well as an overview of some of the technology's current limitations. This episode is sponsored by WorkOS.

Shows are listed from Apple Podcasts' charts and directory, and Podcast Index where it is used. Every show and episode belongs to its publisher and plays from the publisher's own feed; this site hosts none of them.
