Podcasts · This Day in AI Podcast

OpenAI Has No Moat, Google's Godfather of AI Quits & The Rise of Open Source LLMs | E13

· 1 h 02 min · Episode 13

Episode OpenAI Has No Moat, Google's Godfather of AI Quits & The Rise of Open Source LLMs | E13

0:00 1:01:53

In Episode 13 of This Day in AI We Discuss the Leaked Internal Google Document, "We Have No Moat, and Neither Does OpenAI", Discuss "The Godfather" of AI leaving Google, Discuss The Implications of Open Source LLM Advancement, Cover Open Assistant's Comparable Model to ChatGPT, OpenAI's Code Interrupter and Touch of Democratizing LLM Alignment.

If you like this episode please consider subscribing and liking the episode to help others discover the podcast.

TIMESTAMPS: ==== 00:00 - Godfather of AI Quits Google Cold Open 00:17 - Google & OpenAI Have No Moat: Advancement of Open Source LLMs 21:13 - 'Godfather of AI' Quits Google 30:54 - Open Assistant & Training LLMs using AI 40:52 - What Increased Prompt Sizes Mean & Long Range Transformers 50:49 - AI Agents, AI Disruption & Mark Zuckerberg's Agent Plan for Meta

SOURCES ==== https://www.semianalysis.com/p/google-we-have-no-moat-and-neither https://www.nytimes.com/2023/05/01/technology/ai-google-chatbot-engineer-quits-hinton.html https://www.theverge.com/2023/4/26/23699633/mark-zuckerberg-meta-generative-ai-chatbots-instagram-facebook-whatsapp https://arxiv.org/pdf/2305.01625.pdf https://twitter.com/tanayj/status/1653243500354322436?s=46&t=uXHUN4Glah4CaV-g2czc6Q https://restofworld.org/2023/chatgpt-taking-kenya-ghostwriters-jobs/ https://www.oneusefulthing.org/p/it-is-starting-to-get-strange https://www.nvidia.com/en-au/autonomous-machines/embedded-systems/ https://open-assistant.io/chat

The episode on the publisher’s site (opens in a new tab)

Chapters

    Transcript

      Shows are listed from Apple Podcasts' charts and directory, and Podcast Index where it is used. Every show and episode belongs to its publisher and plays from the publisher's own feed; this site hosts none of them. Explicit shows are for adult profiles only, and children’s profiles hear only children’s shows. More about this list.