Podcasts · The Stack Overflow Podcast
Search engine bots crawled so AI bots could run
· 23 min · Episode 903
Episode Search engine bots crawled so AI bots could run
Ryan hosts Akamai data scientist Robert Lester on the show to discuss how the growth of AI bots affects internet traffic, the ways these AI bots differ from the original search engine optimization ones, and why you might not want to mitigate AI bots on your websites.
Episode notes:
Akamai is a CDN, full-stack cloud computing, and cybersecurity company that keeps experiences closer to users and threats further away using the world’s most distributed compute platform.
Connect with Robert on LinkedIn and check out his AI Pulse blogs.
Today’s shoutout goes to user Evan Phoenix for winning a Populist badge for their answer to llvm ir back to human-readable source language?.
TRANSCRIPT
See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.
Links in the notes 8
- https://www.akamai.com/
- https://www.linkedin.com/in/robert-lester-4a50321a7/
- https://www.akamai.com/blog?author=robert-lester
- https://stackoverflow.com/users/643905/evan-phoenix
- https://stackoverflow.com/questions/5180914/llvm-ir-back-to-human-readable-source-language
- https://stackoverflow.blog/2026/01/06/search-engine-bots-crawled-so-ai-bots-could-run
- https://art19.com/privacy
- https://art19.com/privacy#do-not-sell-my-info
Shows are listed from Apple Podcasts' charts and directory, and Podcast Index where it is used. Every show and episode belongs to its publisher and plays from the publisher's own feed; this site hosts none of them. Explicit shows are for adult profiles only, and children’s profiles hear only children’s shows. More about this list.