LWiAI Podcast #189 - Chat.com, FrontierMath, Relaxed Transformers, Trump & AI

Our 189th episode with a summary and discussion of last week's big AI news!

Hosted by Andrey Kurenkov and Jeremie Harris.
Feel free to email us your questions and feedback at contact@lastweekinai.com and/or hello@gladstone.ai

Subscribe here:
RSS: http://bit.ly/AItalkRSS
iTunes: http://bit.ly/AItalkiTunes
Spotify: http://bit.ly/AItalkSpotify

In this episode:

* OpenAI's acquisition of chat.com and internal shifts, including hardware lead hire and hardware model leaks, signal significant strategy pivots and challenges with model scaling and security. 
* Saudi Arabia plans a $100 billion AI initiative aiming to rival UAE's tech hub, highlighting the region's escalating AI investments. 
* U.S. penalties on GlobalFoundries for violating sanctions against SMIC underline ongoing challenges in enforcing AI-chip export controls. 
* Anthropic collaborates with Palantir and AWS to integrate CLAWD into defense environments, marking a significant policy shift for the company.

Sponsors:

• The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence.

• The AI safety book “Uncontrollable" which is not a doomer book, but instead lays out the reasonable case for AI safety and what we can do about it. Max TEGMARK said that “Uncontrollable” is a captivating, balanced, and remarkably up-to-date book on the most important issue of our time" - find it on Amazon today!

If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form.

Timestamps + Links:

• (00:00:00) Intro / Banter

• (00:01:28) News Preview

• (00:02:10) Response to listener comments

• (00:05:02) Sponsor Break

• Tools & Apps

  • (00:07:31) OpenAI Introduces ‘Predicted Outputs’ Feature: Speeding Up GPT-4o by ~5x for Tasks like Editing Docs or Refactoring Code

  • (00:11:55) Anthropic’s Haiku 3.5 surprises experts with an “intelligence” price increase

  • (00:17:10) Introducing FLUX1.1 [pro] Ultra and Raw Modes

  • (00:19:11) X is testing a free version of Grok AI chatbot in select regions

• Applications & Business

  • (00:21:39) OpenAI acquired Chat.com

  • (00:23:40) Saudis Plan $100 Billion AI Powerhouse to Rival UAE Tech Hub

  • (00:28:28) Meta’s former hardware lead for Orion is joining OpenAI

  • (00:31:38) OpenAI Accidentally Leaked Its Upcoming o1 Model to Anyone With a Certain Web Address

  • (00:35:50) Nvidia Rides AI Wave to Pass Apple as World’s Largest Company

• Projects & Open Source

  • (00:37:53) ‘Unrestricted’ AI group Nous Research launches first chatbot — with guardrails

  • (00:41:48) FrontierMath: The Benchmark that Highlights AI’s Limits in Mathematics

  • (00:46:29) Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by Tencent

• Research & Advancements

  • (00:49:55) Applying “Golden Gate Claude” mechanistic interpretability techniques to protein language models.

  • (00:58:3) Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA

  • (01:05:55) From Naptime to Big Sleep: Using Large Language Models To Catch Vulnerabilities In Real-World Code

  • (01:10:22) OpenAI reportedly developing new strategies to deal with AI improvement slowdown

• Policy & Safety

  • (01:19:52)  What Donald Trump’s Win Means For AI

  • (01:28:44) Fab Whack-A-Mole: Chinese Companies are Evading U.S. Sanctions

  • (01:33:57) US fines GlobalFoundries for shipping chips to sanctioned Chinese firm

  • (01:36:55) Anthropic teams up with Palantir and AWS to sell its AI to defense customers

• (01:39:23) Outro