Podcasts · Practical AI

Software and hardware acceleration with Groq

· 43 min · Episode 308

Episode Software and hardware acceleration with Groq

0:00 43:24

How do you enable AI acceleration (at both the hardware and software layers) that stays ahead of rapid industry shifts? In this episode, Dhananjay Singh from Groq dives into the evolving landscape of AI inference and acceleration. We explore how Groq optimizes the serving layer, adapts to industry shifts, and supports emerging model architectures.

Featuring:

• Dhananjay Singh – LinkedIn, X • Chris Benson – Website, GitHub, LinkedIn, X • Daniel Whitenack – Website, GitHub, X

Links:

• Groq

Sponsors:

• Augment Code - Developer AI that uses deep understanding of your large codebase and how you build software to deliver personalized code suggestions and insights. Augment provides relevant, contextualized code right in your IDE or Slack. It transforms scattered knowledge into code or answers, eliminating time spent searching docs or interrupting teammates.

The episode on the publisher’s site (opens in a new tab)

Chapters

    Transcript

      Shows are listed from Apple Podcasts' charts and directory, and Podcast Index where it is used. Every show and episode belongs to its publisher and plays from the publisher's own feed; this site hosts none of them. Explicit shows are for adult profiles only, and children’s profiles hear only children’s shows. More about this list.