# Simplifying On-Device AI for Developers with Siddhika Nevrekar - #697

An episode of [The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)](https://invisiblenetwork.ai/podcast/1116303051), 12 Aug 2024, 47 min.

Audio: https://pscrb.fm/rss/p/traffic.megaphone.fm/MLN7180381574.mp3?updated=1723486873

Today, we're joined by Siddhika Nevrekar, AI Hub head at Qualcomm Technologies, to discuss on-device AI and how to make it easier for developers to take advantage of device capabilities. We unpack the motivations for AI engineers to move model inference from the cloud to local devices, and explore the challenges associated with on-device AI. We dig into the role of hardware solutions, from powerful system-on-chips (SoC) to neural processors, the importance of collaboration between community runtimes like ONNX and TFLite and chip manufacturers, the unique challenges of IoT and autonomous vehicles, and the key metrics developers should focus on to ensure optimal on-device performance. Finally, Siddhika introduces Qualcomm's AI Hub, a platform developed to simplify the process of testing and optimizing AI models across different devices. The complete show notes for this episode can be found at https://twimlai.com/go/697.

Shows are listed from Apple Podcasts' charts and directory, and Podcast Index where it is used. Every show and episode belongs to its publisher and plays from the publisher's own feed; this site hosts none of them.
