Podcasts · DevOps Sauna from Eficode
AI FinOps: Why GPUs are expensive (and often wasted)
· 32 min
Episode AI FinOps: Why GPUs are expensive (and often wasted)
Send us Fan Mail
AI is everywhere, but the real cost often stays hidden.
In this episode of DevOps Sauna, Pinja and Stefan dive into AI FinOps and explore why GPUs are expensive and why so much AI infrastructure ends up underutilized. They unpack hidden costs like idle hardware, power consumption, networking, and data movement, and explain why traditional Cloud FinOps doesn’t fully apply to AI workloads.
They also discuss how Kubernetes and Dynamic Resource Allocation (DRA) can help improve GPU utilization, and why visibility, ownership, and organizational maturity matter just as much as tooling.
Links in the notes 1
Transcript
Shows are listed from Apple Podcasts' charts and directory, and Podcast Index where it is used. Every show and episode belongs to its publisher and plays from the publisher's own feed; this site hosts none of them. Explicit shows are for adult profiles only, and children’s profiles hear only children’s shows. More about this list.