It's been a BIG week in AI news đź—ž
· 41 min · Episode 173
Episode It's been a BIG week in AI news đź—ž
This last week has been a big week for AI news. BigScience is training a huge language model (while the world watches), and NVIDIA announced their latest “Hopper” GPUs. Chris and Daniel discuss these and other topics on this fully connected episode!
Sponsors:
• Fastly – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com • Changelog++ – You love our content and you want to take it to the next level by showing your support. We’ll take you closer to the metal with no ads, extended episodes, outtakes, bonus content, a deep discount in our merch store (soon), and more to come. Let’s do this!
Featuring:
• Chris Benson – Website, GitHub, LinkedIn, X • Daniel Whitenack – Website, GitHub, X
Show Notes:
BigScience Language Model Training
• Model Details • Live model logs and training curves
H100 from NVIDIA
• [White paper](https://www.nvidia.com/en-us/data-center/h100/ https://cf-store.widencdn.net/nvdam/8/4/a/84ae26c1-6774-4083-a41d-4f3d82a6a449.pdf) • Omniverse platform • Earth-2 Supercomputer
Stanford’s AI Index 2022
Upcoming Events:
• Register for upcoming webinars here!
Links in the notes 16
- https://fastly.com/
- https://www.fastly.com/?utm_source=changelog&utm_medium=podcast&utm_campaign=changelog-sponsorship
- https://changelog.com/++
- https://chrisbenson.com
- https://github.com/chrisbenson
- https://www.linkedin.com/in/chrisbenson
- https://x.com/chrisbenson
- https://www.datadan.io/
- https://github.com/dwhitena
- https://x.com/dwhitena
- https://bigscience.notion.site/BigScience-176B-Model-ad073ca07cdf479398d5f95d88e218c4
- https://huggingface.co/bigscience/tr11-176B-ml-logs/tensorboard?tab=scalars&tagFilter=lm%20loss#tensorboard
- https://developer.nvidia.com/nvidia-omniverse-platform
- https://blogs.nvidia.com/blog/2021/11/12/earth-2-supercomputer/
- https://aiindex.stanford.edu/report/
- https://practicalai.fm/webinars
Shows are listed from Apple Podcasts' charts and directory, and Podcast Index where it is used. Every show and episode belongs to its publisher and plays from the publisher's own feed; this site hosts none of them. Explicit shows are for adult profiles only, and children’s profiles hear only children’s shows. More about this list.