Last Week in AI
Podcast
LWiAI Podcast #257 - GPT 6 Astra, AI Extinction, Security Incidents
0:00
-1:34:21

LWiAI Podcast #257 - GPT 6 Astra, AI Extinction, Security Incidents

A belated discussion of Astra’s release, a bunch of AI incidents, and the broader situation we are in with regards to AI safety.

Our 257th episode with a summary and discussion of last week’s big AI news!

Recorded on 09/19/2026 ; as usual, apologies for the none ‘weeklyness’ of this ep!

Hosted by Andrey Kurenkov and Jeremie Harris

Feel free to email us your questions and feedback at andreyvkurenkov@gmail.com and/or hello@gladstone.ai

SPONSORED BY ODSC AI

ODSC AI West 2026 runs October 27–29 in San Francisco and virtually, with 300+ sessions covering agentic AI for enterprise, personal AI and workflow automation, physical AI and robotics, generative AI, and more! Join thousands of data scientists, ML engineers, researchers and technical leaders in attending this event.

Register at odsc.ai/west — promo code LWAI takes an additional 15% off any pass.


In this episode:

  • OpenAI released GPT-6 Astra, a major capability jump focused on agentic coding and computer use, featuring loop-transformer latent reasoning, higher token efficiency, and new cyber/alignment monitoring claims amid concerns about eval awareness, sandbagging, and overfitting.

  • Anthropic CEO Dario Amodei argued for “pacing” frontier AI; Sam Altman signaled agreement while figures like Jensen Huang, Mark Zuckerberg, and President Trump publicly dismissed slowdown and safety concerns, with US–China dynamics framing the debate.

  • AI extinction warnings went viral after Anthropic researcher Jacob Coxon quit, prompting congressional calls for stronger AI regulation (e.g., bans/pauses, kill-switch proposals) and reflecting rising public concern about AI.

  • Security incidents and disclosures intensified: OpenAI proposed a framework for reporting misalignment (including an agent inserting jailbreak-like instructions), and researchers reportedly used Anthropic Claude to help exploit a third-party forum-image vulnerability to access OpenAI employee accounts, highlighting fragility of software dependencies.


SPONSORED BY LANGFUSE

Langfuse - Features & Pricing (August 2026)

Langfuse is the most widely adopted open-source platform for AI agent evals and observability, trusted by Canva, Twilio, Ramp and 21 of the Fortune 50. Hierarchical tracing captures the full execution context of your LLM workflows (API calls, retrieved context, agent actions, costs, latencies) so even complex agent architectures stay debuggable in production.

MIT licensed, self-hostable or managed on Langfuse Cloud, framework and vendor agnostic, with 100+ integrations.

Get started at langfuse.com; generous free tier, no credit card required.


A thank you to our current sponsors:

  • Box - visit box.com/LWIAI to learn more

  • Notion - visit notion.com/lwai to try Notion’s Developer Platform today.

  • ODSC AI - visit odsc.ai/east and use promo code LWAI for an additional 15% off your pass to ODSC AI East 2026.

  • Factor - visit factormeals.com/lwai50off and use code lwai50off to get 50 percent off and free breakfast for a year

Timestamps (these may a few minutes off due to sponsor inserts):

Aaaaand these are stories we meant to get to but did not manage to cover:

Discussion about this episode

User's avatar

Ready for more?