BAD SIGNAL

← News

11 Sep 2026

Anthropic and OpenAI researchers flag recursive self-improvement

11 Sep 2026: the quotes are real. The extinction talk is the speakers’ analysis, not a measured event.

11 Sep 2026: CNBC reported that researchers at Anthropic and OpenAI raised fresh concerns about recursive self-improvement — AI helping build more capable successors.

CNBC: both labs have said in recent months that autonomous model improvement is happening faster than they expected.

CNBC cites an Anthropic post from June: internal data showed Claude accelerating AI development, “a possible path to recursive self-improvement,” happening faster than expected.

CNBC cites an August Anthropic post: engineers on average shipped eight times as much code per quarter as they did between 2021 and 2025.

CNBC: on Saturday, OpenAI chief scientist Jakub Pachocki wrote he was concerned “no-one was prepared for the consequences of a continued rapid rise in machine intelligence,” and that systems in the next few years would “increasingly drive their own development.” That is his essay, not a product change.

Two labs are arguing in public that the loop is speeding up. The filings are the quotes. Human-extinction forecasts stay analysis.

Sources

Comments

Talk under the story. Stay on the sources. Comment guidelines

Loading discussion…

More