Anthropic Calls for a Slowdown in Frontier AI Development

Anthropic has proposed that leading AI labs consider a pause or slowdown in the development of advanced AI to allow societal structures and safety research to catch up. The suggestion comes as the company's own AI, Claude, now writes over 80% of its own code, demonstrating the rapid pace of AI self-improvement.
Anthropic Calls for a Slowdown in Frontier AI Development

Anthropic Calls for a Slowdown in Frontier AI Development Anthropic’s latest warning captures a paradox at the heart of today’s AI race: the company’s own systems are accelerating progress so quickly that its researchers now want the world to be able to slow that progress down.

Early concerns about self-improving AI

On June 4, Anthropic published a blog post warning that AI development is advancing so rapidly that models may soon help build more powerful successors, a process known as “recursive self-improvement.” Axios reported that the company sees signs that “AI systems could become capable enough to autonomously design, build and train more capable successors on their own.” The Verge highlighted Anthropic’s definition of recursive self-improvement as an “AI system capable of fully autonomously designing and developing its own successor,” while stressing the firm’s caveat: “We are not there yet… But it could come sooner than most institutions are prepared for.”

Claude’s accelerating role inside Anthropic

New internal data helped explain the alarm. By May 2026, Anthropic’s Claude model was authoring more than 80% of the code merged into the company’s production codebase, with engineers shipping roughly eight times more code per quarter than in 2024, according to The Next Web’s coverage of the paper “When AI builds itself.” Business Insider separately reported that “more than 80% of the code merged into its codebase is now written by Claude,” and that typical engineers were merging eight times as much code per day as in 2024.

Inside the company, that shift has left some staff unsettled. One Anthropic employee described days when AI works so well that “nothing I do matters,” and others when “everything breaks” and they no longer understand what they’ve been doing, crystallizing workplace confusion over AI’s rapid integration.

From internal data to a call for a global pause option

As these findings were released, Anthropic’s leaders moved from diagnostics to policy proposals. Researchers at The Anthropic Institute argued that AI is now “speeding up the development of new AI models so quickly it could eventually help build its own successors,” and said “it would be good for the world to have the option to slow or temporarily pause frontier AI development to enable societal structures and alignment research to keep up.”

On June 5, another Business Insider report detailed how Anthropic wants leading labs to build a shared mechanism to “slow or temporarily pause frontier AI development” if needed, drawing an analogy to nuclear nonproliferation monitoring while warning the world does not have “decades” to design such a system. The company has simultaneously confidentially filed an S-1, putting it in a race with OpenAI to go public, underscoring how calls for caution are emerging amid intense commercial competition.

Supporters, skeptics, and broader AI debates

The pause option quickly drew mixed reactions. Some policymakers welcomed the focus on risk: former U.S. senator Mitt Romney argued that “our highest and urgent national priority should be AI safeguards,” warning of risks from weapons to “mass unemployment” and even “extinction.” Others in tech saw Anthropic’s move as self-serving, suggesting that invoking nuclear analogies and existential threats while “racing ahead anyway” could be read as a bid for tighter control or even nationalization of frontier labs.

Parallel debates are unfolding in the research community about how to frame AI risks. Meta AI chief scientist Yann LeCun amplified a comment noting that no one seriously claims systems like AlphaFold, Sora, Midjourney, or DALL·E are conscious, spotlighting concerns that public discourse can conflate capability, autonomy, and sentience.

For now, Anthropic insists it is not demanding an immediate halt, but rather a verifiable global “pause mechanism” that could be triggered if self-improving AI systems approach thresholds society is not ready to cross. Whether competitors and governments will help build that safety brake, even as AI drives unprecedented productivity and profit, remains an open question.

Continue reading https://foxvector.com/stories/019e9b5a-6d91-3525-728c-10918660f61b

Write a comment
No comments yet.