Podcasts · The Hardware Podcast with Fexingo: Chips, Devices, and Electronics Engineering Conversations
How Chips Are Using On-Chip Neural Networks for Real-Time Inference
· 8:15 · S3 E108
Episode How Chips Are Using On-Chip Neural Networks for Real-Time Inference
This episode of The Hardware Podcast explores the emerging trend of integrating neural network accelerators directly onto chips for real-time inference at the edge. Lucas and Luna discuss how on-chip neural networks enable low-latency AI processing without cloud dependency, using the example of Syntiant's NDP120 chip that achieves 99% accuracy in keyword spotting while consuming under a milliwatt of power. They examine the architecture trade-offs between digital and analog compute-in-memory approaches, and how companies like Mythic and GreenWaves Technologies are pushing the boundaries of ultra-low-power inference for wearables and IoT devices. The conversation also touches on the implications for privacy and the future of distributed intelligence.
#OnChipNeuralNetworks #EdgeAI #TinyML #Syntiant #Mythic #GreenWavesTechnology #ComputeInMemory #KeywordSpotting #UltraLowPower #Wearables #IoT #AIAccelerator #NeuralNetwork #RealTimeInference #Technology #Hardware #FexingoBusiness #BusinessPodcast
Keep every episode free: buymeacoffee.com/fexingo
Links in the notes 1
Transcript
Shows are listed from Apple Podcasts' charts and directory, and Podcast Index where it is used. Every show and episode belongs to its publisher and plays from the publisher's own feed; this site hosts none of them. Explicit shows are for adult profiles only, and children’s profiles hear only children’s shows. More about this list.