
#23: Are we on the cusp of an intelligence explosion?
About this event
Please read the materials and bring a copy with you to the session.
When: Wednesday 9th December 2026, 6 pm – 8 pm.
Where: The Castle Inn, 36 Castle Street, Cambridge, UK. (Most
likely we'll be at one of the large tables upstairs.)
Primary reading:
Independent Assessment of AI R&D Acceleration at Anthropic in October 2026
https://metr.org/blog/2026-11-05-anthropic-ai-rd-acceleration-assessment/
Description (taken from report):
From August 12 to October 29, 2026, METR staff performed a high-access evaluation at Anthropic to assess the degree to which AI is accelerating AI R&D. If AI systems started to significantly accelerate further AI development, this could lead to a sudden emergence of extreme and risky capabilities.
Anthropic offered unprecedented access to internal data on their AI R&D process, including a variety of metrics on pretraining, reinforcement learning (RL), training compute in each domain, benchmark scores for internal models, AI speedup analyses, forecasts of a future model’s metrics, and interviews with relevant staff.
In our first section, we share our subjective conclusions about risk. We now believe that:
- As of October 2026, Anthropic is likely improving the capabilities of their models on well-specified tasks at around twice the rate they did between March 2024 and October 2025. This estimate is given with high uncertainty; we would not be surprised if the true acceleration was closer to 1.3x or 3x the historical rate.
- A majority of this acceleration today is likely attributable to Anthropic’s extensive use of AI to do R&D, though there is significant uncertainty and other causes likely played a large role in acceleration in late 2025.
- The lack of observed bottlenecks or strong diminishing returns means there is a significant risk that further capabilities progress could lead to even faster acceleration, though, as we say below, we may be missing important bottlenecks.
Extra reading:
The avalanche that hit math is coming for AI development: Why I now expect superintelligence by 2030
https://www.dwarkesh.com/p/rsi
Is Anthropic on the cusp of RSI? Inside the redacted METR report
https://80000hours.org/podcast/episodes/metr-anthropic-recursive-self-improvement-rsi/
Yes, you should panic about AI
https://rutgerbregman.substack.com/p/yes-you-should-panic-about-ai
Q3.5 Timelines Update: Looks Like the Intelligence Explosion Will Happen in 2027 After All
https://blog.aifutures.org/p/q35-timelines-update-looks-like-the
Anthropic’s AI acceleration is probably real: Triangulating METR’s report with public data
https://blog.karthiktadepalli.com/p/metr-anthropic-report
Source: meetup