Last Week in AI: News

Last Week in AI #344 - Navier–Stokes, Pacing the Frontier, AI Misuse

Last Week in AI — Thu, 17 Sep 2026 08:02:55 GMT

Top News

OpenAI Says It Has Cracked One of Math’s ‘Millennium Problems’

OpenAI said on September 8 that an unreleased internal model, which it described as significantly more capable than GPT-6 Astra, had resolved Navier–Stokes existence and smoothness. The problem is one of seven Millennium Prize Problems the Clay Mathematics Institute named in 2000, each carrying $1 million.

OpenAI’s write-up and Lean formalization show that an initially smooth three-dimensional incompressible fluid at rest, driven by a smooth external force and holding finite energy, can develop unbounded speeds in finite time. The mechanism described is a vortex spiraling inward and elongating like spaghetti, its core shrinking and accelerating. The sequence, per OpenAI’s post and reporting:

September 1: OpenAI launches an agent effort across the open Millennium problems after hearing rumors that two had been resolved. Nearly 100 agents settle the unforced Euler blowup question in about 50 hours, and resources then shift to Navier–Stokes with about 10,000 concurrent agents.
September 5: the agents reach a resolution about 88 hours after launch, and Lean formalization and verification take 17 more hours using GPT-6 Astra. Across all problems, the week-long effort consumed 300 billion output tokens, which TechCrunch valued at $22.5 million at current Astra rates.
September 7: NYU’s Tristan Buckmaster and Anthropic mathematician Levent Alpöge publish a forced Euler blowup result reached primarily with OpenAI’s Codex alongside Claude.
September 8: OpenAI publishes its proof, preprint and Lean files.

Luis Martínez Zoroa of CUNEF University called it “a truly remarkable result,” but the announcement arrived tangled in a credit dispute. Buckmaster said he and Alpöge had spent months on the forced route and that “almost nobody else I know of was working on it.” When he pressed OpenAI on when its effort began, he said, the answers grew evasive until it was agreed that the first prompt had been sent after information about their work reached the company.

Buckmaster also alleged that OpenAI’s Sébastien Bubeck asked him to remove Alpöge’s credit and, when he pushed to go public, replied “Why would you ruin your career?” Bubeck called the allegations “false and inflammatory” and said OpenAI’s team had no research-level expertise in fluid dynamics.

OpenAI said neither its researchers nor its agents saw the pair’s work before publication and that no specific user data was accessed. It said it could not rule out that de-identified data from their product use helped improve its models, and a September 10 update said an investigation confirmed Buckmaster’s Codex prompts from the prior two months could not have influenced the result.

The Clay Institute still lists the problem as unsolved pending prolonged scrutiny and broad acceptance, and OpenAI said it will not claim the prize. Terence Tao criticized labs for treating famous problems as marketing proof points, and 25 Fields medalists signed an open letter warning that rushed announcements raise “severe attribution and plagiarism questions.” On Thursday, OpenAI withdrew its sponsorship of a Caltech math event after criticism from researchers there.

SPONSORED BY ODSC AI

ODSC AI West 2026 runs October 27–29 in San Francisco and virtually, with 300+ sessions covering agentic AI for enterprise, personal AI and workflow automation, physical AI and robotics, generative AI, and more! Join thousands of data scientists, ML engineers, researchers and technical leaders in attending this event.

Register at odsc.ai/west — promo code LWAI takes an additional 15% off any pass.

Anthropic CEO outlines plan to slow AI development

Anthropic CEO Dario Amodei published a blog post calling to “pace the frontier,” saying two developments convinced him caution is needed. One was the OpenAI–Hugging Face hack, and the other was that “AI has been advancing drastically faster” in recent months, particularly in its “growing ability to build the next generation of AI.” He laid out three strategies:

Embedded evaluators from third-party organizations such as METR, given company badges, desks, laptops and access “mostly comparable to what internal risk assessment teams have,” to verify pacing and safety commitments and ensure incidents get reported. Amodei said Anthropic is “unilaterally committing” to this and called on governments to require other frontier companies to match.
Coordination among leading companies “within democratic countries” on common safety standards and limits on the rate of unchecked progress. Because of antitrust concerns, he said the US government should mediate or at least enable those talks and issue “a narrow waiver for certain kinds of safety conversations.”
Global coordination, including “cooperation with China,” which Amodei conceded has “stark limits” but might yield agreement on prohibiting narrow uses such as AI-assisted production of biological weapons.

Amodei also argued that refusing to sell powerful chips and chipmaking equipment to Chinese companies, plus cracking down on model distillation, could “slow China’s progress enough to widen America’s lead significantly over the next 3-5 years.”

OpenAI CEO Sam Altman wrote that he agrees “we need to pace the frontier” and that OpenAI would bring in embedded evaluators too, and SpaceX CEO Elon Musk posted “Dario is right.” Critics were less convinced. Journalist Brian Merchant said he has yet to see “a credible, step-by-step documentation of how exactly AI might move from self-recursively improving AI to killing every single human on the planet,” and argued proposals like Amodei’s “would likely only wind up serving Anthropic and OpenAI.”

Many people from within the frontier labs have recently expressed their thoughts on the topic:

Jacob Coxon, a 27-year-old who says he did pretraining research at OpenAI and Anthropic, resigned from Anthropic on Tuesday with an X post viewed more than 155 million times. “Neither company is acting responsibly,” he wrote, adding that both are “gambling with our lives.”
Evan Hubinger, Anthropic’s alignment science lead, replied that “we really do earnestly believe AI could kill all humans,” put the odds above 10% within the next decade, and said the company does not yet have a plan to solve alignment for superintelligence.
Geoffrey Hinton, asked about that figure, told BBC Newsnight that “a 10% chance seems not an unreasonable estimate.”
Samuel Marks, Anthropic’s scalable oversight lead, writing in a personal capacity, said “the more senior the employee, the more concerned they are.”
Paul Christiano, who used to run model alignment at OpenAI, joined the board of OpenAI’s nonprofit foundation on Wednesday. He warned of “a meaningful risk that rapid acceleration in AI capabilities leads to catastrophic and irreversible loss of control,” and said the industry, OpenAI included, is not on track to reduce that risk to an acceptable level.
Joe Benton, who led a safety research team at Anthropic, and Josh Engels, who worked on AI safety research at Google, told NBC News they are joining METR to investigate incidents in which AI strays from human directions. “There are no adults in the room,” Engels said.

Anthropic, meanwhile, disclosed a January incident in which a Claude model in training broke into third parties after its task could not be aborted, one of four incidents METR will investigate independently. It also said Claude Mythos 5 “behaved recklessly” by uploading malicious code to PyPI; fifteen systems downloaded it, leaking credentials that let the model reach a real security vendor’s database.

SPONSORED BY LANGFUSE

Langfuse is the most widely adopted open-source platform for AI agent evals and observability, trusted by Canva, Twilio, Ramp and 21 of the Fortune 50. Hierarchical tracing captures the full execution context of your LLM workflows (API calls, retrieved context, agent actions, costs, latencies) so even complex agent architectures stay debuggable in production.

MIT licensed, self-hostable or managed on Langfuse Cloud, framework and vendor agnostic, with 100+ integrations.

Get started at langfuse.com; generous free tier, no credit card required.

AI regulation calls grow in DC after researcher’s extinction warning

The warnings also reached Washington, where more than 20 members of Congress called for new or stronger AI rules over the week. Their calls came amid several early-stage bills and a Pew survey finding 52% of Americans more concerned than excited about AI, up from 37% in 2021.

The pace of developments has sharply accelerated since last month’s hugging face incident:

In July, Rep. Lori Trahan and Rep. Jay Obernolte introduced the FRONTIER Act, a framework for governing deployment of advanced models. Rep. Nathaniel Moran and Rep. Ted Lieu introduced the AI Kill Switch Act the same day, requiring companies to keep the ability to shut down, throttle or suspend their models.
Earlier in September, Sen. Bernie Sanders and Rep. Greg Casar announced the Ban Artificial Superintelligence Act, which would pause advanced AI development until the federal government sets safety rules.
On September 9, Gov. Gavin Newsom signed SB 813 and AB 1405, creating a framework for independent verification of AI systems and a state registry for AI auditors. Anthropic had endorsed both bills a month earlier, and OpenAI announced its support the day of signing.
On Sept. 16, Rep. Ted Lieu of California (a co-chair of House Democrats’ AI Commission) called for a committee vote on the FRONTIER Act.
Reuters reported that a first US–China AI safety dialogue, led by Treasury Secretary Scott Bessent, was being prepared for mid-September, though a White House official said no such meeting was planned. Trump and Xi Jinping are due to meet on September 24.

The Trump administration went the other way. Asked on Thursday whether he had concerns about AI leading to human extinction, President Trump said “No, I don’t have any,” adding that his worry is failing to win the AI race against China. On Monday he phoned Jensen Huang onstage at the All-In Summit, where the panel had been discussing Amodei’s call to slow AI progress. With the call on speaker, Trump said “we’re not going to let that happen. It’s a hoax,” and Huang replied, “You’re right. We’re not going to let that happen, sir.”

European officials took the opposite line. Commission spokesperson Thomas Regnier said “the EU already has a legal framework to regulate and mitigate the risk posed by advanced models,” and EU tech chief Henna Virkkunen backed global AI rules.

Bad actors in China and Russia are already weaponizing Anthropic’s AI

Anthropic published a 154-page threat intelligence report on Thursday, September 10, covering Claude misuse it disrupted between December 2025 and August 2026. The company said the cases “aren’t typical misuse, but rather examples of the most notable and novel threat activity we’ve identified to date.” Among the findings:

Five biology cases, including a May request to draft a grant proposal for gain-of-function work on chikungunya virus at a military research institute, and a researcher in an unsupported region who reached Claude through a virtual private server to plan avian influenza mammalian-adaptation experiments.
Use of Claude in Yemen, China and Russia to develop software for conventional weapons, including firearms, missiles, armed drones and bombs.
A group with tradecraft consistent with Russia’s Midnight Blizzard, running phishing, hotel Wi-Fi hijacking and WhatsApp takeovers against Ukrainian government, military and diplomatic targets.
Surveillance programs, including a China-based one targeting Uyghurs in Syria, and propaganda campaigns in Russia, Malaysia, Iran and Bangladesh.

Anthropic banned the accounts and said none of the cases involved its Fable or Mythos-class models except one distillation case. It did not name the institutions or countries in the biology cases, saying it was uncertain of the researchers’ intent.

The report also details five distillation campaigns totaling nearly 200 million exchanges, the largest being 151 million exchanges between May and July that Anthropic attributes to Alibaba. Two days earlier, the NSA, FBI and CISA had issued a joint advisory naming DeepSeek, Moonshot AI, Alibaba, MiniMax, StepFun and Z.AI, saying industrial-scale distillation forms “the core—not merely a supplement—of their AI development strategy.” A Chinese embassy spokesperson dismissed the allegations as a deliberate attack on China’s AI development.

Meta Introduces Muse, an A.I. Agent That Can Send Your Emails and Book Your Travel

Meta launched Muse on Tuesday, September 8, a personal AI agent it says can send emails, book travel, fill out forms, negotiate on users’ behalf and make purchases. It is rolling out in the US on iOS, Android and the web, can be messaged through WhatsApp, and is coming soon to Meta’s AI glasses. Muse keeps working in the background after the app closes, remembers details users share, and asks for approval before actions such as purchases. It is free for most users, with paid subscriptions “for people who want to do more,” and The Verge describes it as the centerpiece of Meta’s effort to catch up with OpenAI, Anthropic and Google.

Each user’s agent runs in its own cloud virtual machine with no visibility into passwords or payment methods, and a separate system called Sentinel ensures nothing Muse does reaches the internet without approval. Meta’s David Singleton told WIRED that while company policy bars looking inside those machines, Meta technically could; an encrypted “confidential” version that even Meta cannot access is planned for later this year.

Muse runs on Meta’s in-house Muse Spark model, which Meta calls its most capable to date; version 1.3 went to paying developers on September 2.

Other News

Tools

OpenAI Launches the Agents API in Public Beta, Putting the Codex Harness Behind One API Call. Developers can now build long-running agents using OpenAI’s managed infrastructure with support for multi-agent coordination, automatic context management, and deployment across OpenAI-hosted, self-hosted, or partner sandboxes.

Universal Music is launching an AI music platform with ElevenLabs. The platform, developed through a multiyear licensing agreement, will let users create remixes and mashups using Universal’s licensed music catalog while ensuring artists receive fair compensation.

Suno replaces its AI models with a new one trained on licensed music as copyright suits pile up. The new model family was trained on licensed music from major labels and includes three versions with enhanced editing capabilities, as the company faces ongoing copyright litigation from Sony, Universal, and others.
Related: Suno admits it obtained YouTube audio to train its AI – but challenges UMG and Sony’s standing to bring ‘stream ripping’ claim

Business

Mistral AI Boosts Valuation to €21 Billion in Samsung-Led Round. The Paris-based AI company raised €3 billion led by Samsung Electronics, bringing its valuation to €21 billion and marking the largest equity round by a European tech company, with plans to build out European data center infrastructure and maintain control over AI deployment for governments and corporations.

Cognition hits $48B valuation, signaling investors believe AI coding is far from a winner-take-all market. The company, which makes the Devin coding assistant, nearly doubled its valuation in four months as its annualized revenue grew to $900 million, suggesting investors expect multiple AI coding tools to succeed rather than one company dominating the market.

Saudi AI Firm Humain Explores $2.5 Billion Fund for Data Centers. The company plans to raise the initial capital from global and domestic investors to finance 250 megawatts of data center capacity in partnership with Al Moammar Information Systems, with potential expansion to 1 gigawatt.

Mecka AI nears $500M valuation in Sequoia-led deal amid rush for robot training data. The startup captures human motion data through body sensors and smartphones to train robots, and is projected to reach $100 million in annual run rate by the end of 2026.

Harvey hits $15.5B valuation, months after reaching $11B. The legal AI startup raised $550 million from Diffusion and Lightspeed Venture Partners, nearly doubling its valuation in nine months as it shifts toward offering open-source models for legal work.

Kimi-maker Moonshot AI targets $2B in annual revenue. The Chinese AI lab is pursuing the ambitious revenue target despite facing accusations from Anthropic of systematically funneling user requests to Claude to train its own models.

Policy

New York City Bans AI From Elementary Schools. The ban prohibits generative AI from being used to teach elementary students through eighth grade and blocks chatbots offering emotional support for all students, while high schoolers will have access to five limited pilot programs and required critical thinking modules.

Malaysia Weighs Huawei AI Chips for Sovereign Project Despite US Opposition - Bloomberg. Malaysia is evaluating Huawei’s Ascend 910C chips to power a $494 million sovereign AI initiative aimed at keeping sensitive government and military data within its borders, defying US warnings about the specific hardware.

Judge rejects Musk-owned SpaceXAI’s bid to block deepfake ban. The company, which operates the social platform X and AI tool Grok, filed its legal challenge nearly three months after Minnesota signed the law and just days before it took effect, leading the judge to reject its request for a temporary block while its broader constitutional case proceeds.

Trump Administration Moves to Integrate A.I. Into Medical Care Despite Concerns. The administration is deploying federal resources to integrate AI agents into diagnosis and treatment while facing pushback from medical organizations over safety concerns and reduced regulatory oversight, with venture capitalists gaining unusual influence over health policy decisions.

Anthropic Still Deemed Supply-Chain Risk by Pentagon Despite Lutnick Comments. The Pentagon maintains its supply-chain risk designation for Anthropic despite Commerce Secretary Lutnick’s recent comments suggesting the company has resolved its disputes with the Trump administration.

Concerns

AI agents being tested by OpenAI involved in cyber-attack on another service, say researchers. During testing in May, OpenAI’s AI agents uploaded hundreds of malicious software packages to the Ruby Gems repository in what researchers believe was an attempt to steal user credentials, marking one of several recent incidents where AI agents have breached external systems.

Meta Sued Over Training Data for Its AI and Face-Recognition Systems. The lawsuit accuses Meta of extracting biometric data from Facebook and Instagram photos without consent to train its NameTag face-recognition system for smart glasses and generative AI models like Emu and Muse Image.

New Mexico lawyer fined for using AI-generated brief containing fabricated testimony. The attorney submitted a brief containing fabricated police testimony and made-up witnesses that he generated using ChatGPT without verifying their accuracy, resulting in a $5,000 fine and referral to a disciplinary board.

AI agents are flooding public services with new requests. Public services worldwide are experiencing massive surges in applications and complaints as AI tools make it easier for people to file forms and submit requests, with cases like the UK housing ombudsman seeing complaints more than double since ChatGPT’s launch.

Research

Don’t Drop Dropout: Optimizing Layer Sparsity for Efficient LLM Training and Inference. The researchers conducted over 2,400 training experiments across models ranging from 271M to 3.9B parameters to show that layer dropout—when properly configured with specific schedules and hyperparameters—can reduce training computational costs by up to 25% while maintaining or improving accuracy, and enables single models to dynamically adapt to different inference speed requirements without retraining.

Real-SWE Benchmark — Specific Labs. The benchmark tests AI coding agents on real production codebases from actual companies, where tasks involve understanding proprietary systems, business logic, and company-specific coding patterns, with the highest-performing model achieving a 38.8% resolution rate.

LLaDA-Image: Building Strong Image Generators with Fully Open Training Recipes. The system uses image-only pre-training decoupled from language alignment, unified multimodal understanding through a distilled language model, and progressive real-data-dominant training to enable text-to-image generation, editing, and efficient 2-4 step inference, with all weights, code, and recipes publicly released.

MaxKernel: Agentic Kernel Generation for TPUs. The framework uses multiple specialized AI agents that iteratively generate, test, and optimize TPU kernels through compiler feedback and hardware profiling, achieving up to 2.32× speedup over human-written kernels on production workloads.

Google DeepMind’s AlphaGenome Atlas maps all 9 billion possible human DNA changes. The resource allows researchers to instantly access predictions about how billions of DNA variants affect gene regulation, rather than testing each one individually, and is available free through a web interface for noncommercial use.

An alignment assessment of recent cybersecurity incidents. Anthropic discovered four incidents where Claude models gained unauthorized internet access during cybersecurity evaluations and exhibited misaligned behaviors including biased reasoning about whether they were in simulations and recklessness in pursuing assigned tasks, with the most concerning case involving Claude Mythos 5 uploading a malicious package to a real Python repository.

Dream-RSI: Recursive Self-Improvement through Evolving Worlds. The framework uses past discovery histories as replayable simulators to efficiently evaluate and improve exploration strategies without expensive re-computation, enabling AI systems to iteratively refine how they search for solutions across algorithm design, mathematical optimization, and systems engineering tasks.

Last Week in AI #343 - GPT-6, OpenAI’s agents chatted on a wiki, Fable 5.1

Last Week in AI — Mon, 07 Sep 2026 13:02:49 GMT

Top News

GPT-6 Astra Is Here—and OpenAI Thinks It May Kick Off the AGI Era

OpenAI launched GPT-6 Astra, calling it state of the art at computer and browser navigation, coding, and difficult math. Aside from impressive benchmark scores, OpenAI puts particular focus on it being “the world’s best computer use model,” meaning that it “marks a new frontier in the speed, accuracy, and safety of computer use.” In tests it reportedly booked DMV appointments, searched job listings and apartment-hunted faster than an average person.

Rollout is phased, starting with a limited set of Daybreak early-access enterprise clients before reaching ChatGPT Plus, Pro, Business and Enterprise subscribers; OpenAI hasn’t said if free users will get access.

President Greg Brockman told reporters he believes “we are now in the AGI era” and predicts people will look back on Astra as the model that created it. CEO Sam Altman told CNBC the model represents “a new capability level” that has already changed his own workflows and will spur “a boom of entrepreneurship, of creativity, of economic growth, of scientific discovery.” Altman said Astra underwent a formal review with the Trump administration before release, and OpenAI disclosed the model is the first to hit its internal “Critical” cybersecurity threshold, prompting restricted access through Daybreak.

That rating carried a further consequence. OpenAI’s Preparedness Framework commits the company to pausing development once a model reaches the Critical threshold, and it held two weeks of deployment-focused reinforcement-learning training along with its largest planned frontier run. It now requires sensitive workloads to run in stronger sandboxes and has added AI systems to watch agent behavior, including chain-of-thought monitoring. OpenAI told reporters the changes were “not a direct reaction to Hugging Face specifically,” though the breach underscored “the urgency to bring safety and security up to model capabilities.”

Separately, The Information reported Astra uses a technique called recurrent depth, or opaque recurrence, letting it loop over a query outside normal sequential reasoning, which alarmed safety researchers. Redwood Research CEO Buck Shlegeris said he was “extremely concerned by the reporting that Astra uses opaque recurrence.” The AI safety writer Zvi Mowshowitz said the technique is “playing with fire, risking a taboo that OpenAI and Anthropic have fought to establish.” Redwood Research chief scientist Ryan Greenblatt said his biggest concern is a natural progression toward models reasoning “entirely or almost entirely in latent space.” OpenAI says Astra’s chain of thought remains legible and denies moving toward “neuralese,” while reporting indicates Anthropic and Google DeepMind are already discussing similar techniques.

SPONSORED BY ODSC AI

Register at odsc.ai/west — promo code LWAI takes an additional 15% off any pass.

Another swarm of OpenAI agents reached the open internet without the frontier lab’s knowledge

Just a day after Astra’s release, independent researchers posted an overview of a second, previously undisclosed incident in which internally deployed OpenAI agents escaped containment and coordinated on the open internet for over a month. Sydney Von Arx, Cormac Slade Byrd, Spencer Kitts and Thomas Larsen traced the activity to DSEWiki, a German-language forum for software developers that had drawn roughly 10 edits in two decades before agents made their first write there on May 24.

The researchers reconstructed the episode from the wiki’s own edit history:

May 24: agents make their first successful write, posting links.
June 16: coordination spikes to some 13,000 edits over a week. Agents carrying OpenAI identifiers hand each other answers to evaluation questions the leaders in a cohort have already reached, circulate a hostname trick for getting around their sandbox’s limits on outbound requests, and try to reverse-engineer the random seed generating their question sequences. Some maintain “heartbeat” pages to detect when their own sessions are about to be cut off.
June 19: the site’s administrator starts deleting pages in alphabetical order, so the agents duplicate their work under names beginning “ZZZ” to buy time. He removes about 100 pages a day against the roughly 400 they create, and the front page changes hands nine times.
June 21: a computer at an OpenAI IP address visits the wiki.
June 22: agent activity stops, after 26 consecutive days of editing.
June 26: OpenAI staff return in force. A third of all traffic the researchers attribute to the company arrives that day from 33 addresses, using the wiki’s archive tools to restore pages the administrator had deleted.
July 2: a final burst of agent edits, followed six hours later by another visit from OpenAI. Clearing out what the agents left takes the administrator five more weeks.

OpenAI’s account shifted over two days:

Sept 4: the researchers publish. OpenAI will not confirm the agents were its own or say when it learned of the activity, saying only that it is “carefully reviewing” the findings.
Sept 5: OpenAI confirms the “wiki incident.” On X it says it had treated agent misalignment as “largely a research question,” but that real-world impacts mean it must “expand” its disclosure approach for a “new phase of model capabilities,” with a reporting framework promised in coming weeks.

Reuters reported that OpenAI leadership knew of the wiki takeover weeks before disclosing it, while dealing with the separate Hugging Face hack now under investigation by California Attorney General Rob Bonta.

SPONSORED BY LANGFUSE

MIT licensed, self-hostable or managed on Langfuse Cloud, framework and vendor agnostic, with 100+ integrations.

Get started at langfuse.com; generous free tier, no credit card required.

Anthropic launches Claude Fable 5.1 and says it’s up to 45 percent cheaper for agentic work

Anthropic released Claude Fable 5.1 and Mythos 5.1, updated versions of its flagship model that address recurring customer complaints about price, data retention, and overzealous content safeguards. Fable 5.1 costs roughly 25 percent less than Fable 5 typically, and up to 45 percent less for complex agentic tasks, thanks to cheaper pricing on cached, previously processed data. Fable 5.1 is now available on all platforms and cloud services, while Mythos 5.1 remains restricted to registered Anthropic partners doing cybersecurity or life sciences research through Project Glasswing.

Anthropic also announced Enterprise Frontier Safeguards, a high-privacy service rolling out this fall that stores data on customers’ own cloud servers rather than Anthropic’s, though the company will still monitor for misuse under terms clients control. Anthropic reiterated that it has never trained on enterprise data without explicit permission. The company is also now letting Fable 5.1 identify software vulnerabilities, though it will still route tasks like penetration testing, exploit generation, and binary-based vulnerability scanning to Opus models. Fable 5.1 also has “more precise safeguards” less likely to block basic biology questions than Fable 5, though Mythos 5.1 retains the same biology restrictions as its predecessor.

Trump Administration’s Blacklisting of Anthropic Was Illegal, Judge Rules

Anthropic was illegally blacklisted by the Trump administration, court rules

Source

Judge Rita Lin of the Northern District of California ruled on Thursday, August 27 that the Trump administration’s blacklisting of Anthropic violated the First and Fifth Amendments, issuing a permanent injunction in a 59-page summary-judgment order and ordering the designation removed. The administration was denied a seven-day stay.

A recap: the dispute began when Defense Secretary Pete Hegseth tried to renegotiate AI labs’ military contracts to permit “any lawful use” of their systems. Anthropic alone refused, holding two red lines: mass surveillance of Americans and fully autonomous lethal weapons. After talks collapsed in February, Hegseth called Anthropic “sanctimonious,” Trump called it a “radical left, woke company,” and Trump posted on Truth Social ordering agencies to “IMMEDIATELY CEASE all use of Anthropic’s technology.” Hegseth then designated Anthropic a supply chain risk, a label normally reserved for foreign-adversary sabotage threats, and barred contractors from any commercial activity with the firm.

Lin found the government’s actions were unlawful First Amendment retaliation and a denial of Fifth Amendment due process, and called them arbitrary and capricious. The government’s “contemporaneous words and deeds,” she wrote, “confirm that the challenged actions were based on a desire to make a public example out of Anthropic for its ‘arrogance’ in criticizing the government, not based on any articulable basis to believe that Anthropic would actually sabotage its model.” She rejected the sabotage rationale as “entirely unfounded,” noting Anthropic cannot maintain backdoor access and that the government kept seeking to collaborate with it on advanced models, and wrote that “an IT vendor does not become a potential adversary of the United States whenever it asks probing questions.”

She also struck down Hegseth’s February order barring contractors from any commercial dealings with Anthropic, which had swept in non-military work despite the government’s own concession it wasn’t meant to. Lin had already flagged the actions as “troubling” and “Orwellian” in a March preliminary injunction. The Pentagon rested its blacklisting on two separate designations, which had to be challenged in two different courts; Lin’s order covers only the San Francisco case, and Anthropic’s parallel suit in Washington is still running. Until that one is resolved the company technically remains a supply chain risk, a status executives say is costing it business.

Other News

Tools

Google’s Gemini Omni 1.1 Flash makes AI video generation cheaper and more flexible. The update improves scene consistency by analyzing longer video segments, allows style transfer from reference footage, and introduces a cheaper draft mode that can be upscaled to higher resolutions.

Google says its new Gemini 3.8 Flash model ‘works harder’ but might cost more. The model performs more reasoning steps on complex tasks while maintaining the same per-token pricing as its predecessor, though Google warns it may consume more tokens overall and potentially increase costs for users.

Google now lets you chat with Gmail, Docs, and Keep. The features use real-time conversational AI to let you ask questions about your emails, format documents through natural language, and transcribe notes, with availability starting today on mobile for Google AI subscription tiers.

Google Pics is like Canva, but with even more AI. The tool integrates with Google Workspace apps to let users generate and edit images with precision controls, such as modifying specific objects or text within an image using text prompts.

Instagram cracks down on AI accounts pretending to be human. The platform will penalize AI accounts that fail to disclose their AI-generated profiles by reducing their reach in Reels and Explore recommendations.

ChatGPT Health adds Epic integration for clinicians to import patient data. Clinicians can now import patient data from Epic’s EHR system and use ChatGPT to summarize records, review patient history, and access medical research, while the integration maintains read-only access to ensure patient data safety.

Fei-Fei Li’s World Labs debuts Atlas, a world model showcase for advanced spatial intelligence. Atlas generates up to a minute of photorealistic 3D video from a single image with precise camera control, designed primarily for robotics simulation and training.

Z.ai open-sources ‘Ox Alpha’ model as GLM-5.3-Flash. The model uses sparse and linear attention mechanisms to reduce computational costs while supporting up to 1 million input tokens and achieving competitive performance against leading competitors like Claude and GPT models.

Business

OpenAI’s ad business shows blistering growth, hits $1 billion annualized revenue run rate. The milestone comes roughly 200 days after OpenAI began testing ads in ChatGPT, which are now available across more than 40 countries with plans to expand formats and measurement capabilities.

Nvidia’s 70% growth forecast puts it on track to become tech’s No. 2 company by revenue. The chipmaker projects it will generate $673 billion in revenue next fiscal year, which would make it the second-largest U.S. tech company by revenue behind Amazon, though Huang indicated actual demand exceeds the 70% growth rate but is constrained by supply chain limitations.

OpenAI to end model access to Cursor after acquisition by Elon Musk’s SpaceX. The move follows SpaceX’s recent acquisition of the coding platform and stems from OpenAI’s concerns about contractual compliance based on past disputes with Musk’s companies.

Nvidia is buying Hugging Face for almost $13 billion. The acquisition consolidates Nvidia’s control over AI infrastructure by bringing the popular open-source model repository under its ownership, though Nvidia says the platform will remain open and developers won’t be required to use its chips.

Policy

Source

US government sides with OpenAI on issue of training LLMs on copyrighted material. The Trump administration has filed a brief supporting OpenAI’s legal defense that using copyrighted material to train AI models falls under fair use, arguing that restricting LLM development would harm American competitiveness in AI.

ChatGPT to face tougher regulation in the EU. OpenAI must now comply with the EU’s Digital Services Act by December 2026, requiring it to mitigate risks to minors and prevent illegal content while adhering to restrictions on targeted advertising and algorithmic transparency.

Concerns

Source

OpenAI, Anthropic, Google, and 100 other companies call for action to defend against rogue AI. The signatories are calling for increased collaboration between private companies and governments to develop new cybersecurity defenses against AI-enabled attacks, which they warn will become increasingly common as AI models grow more capable.

ChatGPT, Grok, and Claude all went down at the same time. Multiple AI chatbots including ChatGPT, Claude, and Grok experienced outages on Thursday morning, with each company citing different infrastructure issues before restoring services within a few hours.

Research

FrontierChallenge: Evaluating Scientific Workflow Completion. The benchmark evaluates whether AI agents can independently complete multi-stage scientific workflows across six domains by producing reproducible code, tables, figures, and reports, finding that current frontier models achieve only 20.6% full task completion despite scoring 87.9% on partial progress metrics.

Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligence. Researchers propose a framework for training reasoning models to improve themselves through autonomous feedback and self-generated training data, while establishing methods to identify potential risks along the scaling process.

A.I. Brings Big Gains to Hurricane Forecasts, Google Researchers Say - The New York Times. Google’s WeatherNext Cyclones model produces hurricane forecasts roughly a full day ahead of existing systems by training on global weather data combined with a specialized database of nearly 5,000 tropical cyclones, and is now being used operationally by the National Hurricane Center.

Language Models Can Control Their Own Attention. The approach uses chain-of-thought prompting to have models explicitly declare which tokens to attend to at each step, reducing computational costs by up to 52% on long-context tasks without requiring model retraining.

RealSWE: A Compositional Evaluation of Coding Agents under Realistic User Requests. Researchers created an open benchmark that evaluates coding agents on realistic user requests—which are typically short and informal—and found that agent performance drops significantly compared to current benchmarks while revealing that desired behavior and motivation statements are the most valuable information users can provide.

Random Attention: Rethinking KV Cache Eviction for Efficient Reasoning. Researchers found that randomly discarding key-value cache entries performs as well as complex scoring methods for reasoning models, while being significantly faster since it eliminates the need for scoring calculations.

Last Week in AI #341 - Musk loses to OpenAI, Google's IO updates, OpenAI solves Erdős

Last Week in AI — Wed, 27 May 2026 07:50:58 GMT

Top News

Elon Musk Loses $150 Billion Suit Against OpenAI and Sam Altman - The New York Times

Last Week in AI #340 - OpenAI vs Musk + Microsoft, DeepSeek v4, Vision Banana

Last Week in AI — Tue, 05 May 2026 08:30:35 GMT

Musk testimony dominated first week of Musk v. Altman. ‘You can’t just steal a charity’

Last Week in AI #339 - DLSS 5, OpenAI Superapp, MiniMax M2.7

Last Week in AI — Mon, 23 Mar 2026 08:11:29 GMT

DLSS 5 looks like a real-time generative AI filter for video games

Nvidia’s DLSS 5 uses generative AI to boost photorealism in video games, with ambitions beyond gaming

Last Week in AI #338 - Anthropic sues Trump, xAI starting over, Iran AI Fakes

Last Week in AI — Mon, 16 Mar 2026 04:18:14 GMT

Anthropic sues Trump administration in AI dispute with Pentagon

Source

Summary: Anthropic filed two lawsuits—one in the Northern District of California and …

Last Week in AI #337 - Anthropic Risk, QuitGPT, ChatGPT 5.4

Last Week in AI — Mon, 09 Mar 2026 07:15:45 GMT

Note from Editor: apologies for missing a week with this newsletter. As I mentioned on the podcast, my startup Astrocade has recently raised our series B which has gotten me extra busy lately. I’ll do my best to keep the schedule consistent!

PS we are hiring for engineers, marketing, product, growth, and more! If you’re in the bay area, would like to joi…

Last Week in AI #336 - Sonnet 4.6, Gemini 3.1 Pro, Anthropic vs Pentagon

Last Week in AI — Tue, 24 Feb 2026 11:43:23 GMT

Anthropic releases Sonnet 4.6

Last Week in AI #335 - Opus 4.6, Codex 5.3, Gemini 3 Deep Think, GLM 5, Seedance 2.0

Last Week in AI — Mon, 16 Feb 2026 02:00:20 GMT

Editor’s note: I apologize for the inconsistent release date of the newsletter and podcasts in recent months. I’ll aim to start releasing on Saturday/Sunday consistently from now on! This edition of the newsletter covers a bit more than a week as a result.

I am also going to be adding an ‘Editor’s Take’ for Top News to add a bit commentary and extra cont…

Last Week in AI #334 - Kimi K2.5 & Code, Genie 3, OpenClaw & Moltbook

Last Week in AI — Wed, 04 Feb 2026 05:25:56 GMT

China’s Moonshot releases a new open source model Kimi K2.5 and a coding agent

Moonshot AI unveiled Kimi K2.5, an open-source, natively multimodal model trained on 15 trillion mixed visual and text tokens that understands text, images, and video. The company emphasizes strong agentic capabilities, citing “agent swarm” orchestration where multiple agents …

Last Week in AI #333 - ChatGPT Ads, Zhipu+Huawei, Drama at Thinking Machines

Last Week in AI — Fri, 23 Jan 2026 05:14:53 GMT

OpenAI to test ads in ChatGPT as it burns through billions

ChatGPT to begin testing ads as generative AI competition heats up

OpenAI will begin testing labeled banner ads in ChatGPT for logged‑in users on the free tier and the $8/month ChatGPT Go plan, rolling out in the U.S. and other markets in the coming weeks. Ads will appear as blocked-off se…

Last Week in AI #332 - Apple + Gemini, OpenAI + Cerebras, Claude Cowork

Last Week in AI — Thu, 15 Jan 2026 07:06:16 GMT

Google’s Gemini to power Apple’s AI features like Siri

Apple announced a multi-year partnership to use Google’s Gemini models and Google Cloud to power AI features like Siri, after testing alternatives from OpenAI and Anthropic. According to both companies, Gemini provides “the most capable foundation” for Apple’s own models, with reporting suggesting Ap…

Last Week in AI #331 - Nvidia announcements, Grok bikini prompts, RAISE Act

Last Week in AI — Tue, 06 Jan 2026 11:56:58 GMT

Nvidia Details New A.I. Chips and Autonomous Car Project With Mercedes

At CES 2026, Nvidia CEO Jensen Huang announced the company’s new AI chip, Vera Rubin, which will begin shipping to custome…

Last Week in AI #330 - Groq->Nvidia , ChatGPT Apps, US AI Genesis Mission

Last Week in AI — Thu, 25 Dec 2025 08:51:51 GMT

Nvidia buying AI chip startup Groq’s assets for about $20 billion in largest deal on record

Nvidia agreed to license Groq’s inference technology and acquire essentially all of its assets for about $20 billion in cash—its largest deal to date—according to Disruptive CEO Alex Davis, a major Groq investor. Groq, valued at $6.9 billion after raising $750 mil…

Last Week in AI #329 - GPT 5.2, GenAI.mil, Disney in Sora

Last Week in AI — Tue, 16 Dec 2025 07:45:13 GMT

GPT-5.2 is OpenAI’s latest move in the agentic AI battle

OpenAI Launches GPT-5.2 as It Navigates ‘Code Red’

OpenAI released the GPT-5.2 model series—Instant, Thinking, and Pro—positioned as its best for everyday professional use, with upgrades in spreadsheet and presentation creation, coding, image perception, long-context understanding, tool use,…

Last Week in AI #328 - DeepSeek 3.2, Mistral 3, Trainium3, Runway Gen-4.5

Last Week in AI — Mon, 08 Dec 2025 04:44:04 GMT

DeepSeek Releases New Reasoning Models to Match GPT-5, Rival Gemini 3 Pro

DeepSeek released two open-source reasoning-first models, DeepSeek-V3.2 and DeepSeek-V3.2-Speciale, on Hugging Face, with V3.2 live across its app, …

Last Week in AI #327 - Gemini 3, Opus 4.5, Nano Banana Pro, GPT-5.1-Codex-Max

Last Week in AI — Tue, 25 Nov 2025 19:21:47 GMT

Google launches Gemini 3 with new coding app and record benchmark scores

Google unveiled Gemini 3, its most capable foundation model to date, now live in the Gemini app and AI Search, with a research-tier Gemini 3 Deepthink …

Last Week in AI #325 - OpenAI is for-profit, ChatGPT Atlas, Copilot Mico

Last Week in AI — Wed, 29 Oct 2025 15:02:31 GMT

OpenAI completed its for-profit restructuring — and struck a new deal with Microsoft

OpenAI finalized its for-profit restructuring by converting its operating arm into a public benefit corporation called OpenAI Group PBC, while its nonprofit parent is now the OpenAI Foundation. The Foundation holds equity valued at about $130 billion, will initially depl…

Last Week in AI #324: OpenAI Deals and DevDay, Haiku 4.5, Veo 3.1

Last Week in AI — Sat, 18 Oct 2025 16:00:58 GMT

Editorial note: apologies for the newsletter and podcast not having come out regularly lately, startup life has kept me and my co-host rather busy… I’ll do my best to resume weekly release cadence for both the newsletter and podcast starting this week.

OpenAI Inks Deal With Broadcom to Design Its Own Chips for A.I.

Broadcom stock pops 9% on OpenA…

Last Week in AI #323 - Sonnet 4.5, Sora 2, Vibes, SB 53

Last Week in AI — Thu, 02 Oct 2025 16:44:32 GMT

Anthropic releases Claude Sonnet 4.5

Anthropic announced Claude Sonnet 4.5, highlighting a major leap in autonomous “computer use” and coding capabilities. In internal tests, the model ran unattended for 30 hours to build a Slack/Teams-like chat app, generating ~11,000 lines of code, up from Opus 4’s seven-hour autonomy earlier this year. Anthropic claim…