LessWrong (30+ Karma) podcast

“Do verifiable metrics overestimate RSI?” by Alec Harris

0:00
8:37
15 Sekunden vorwärts
15 Sekunden vorwärts

Last week, METR released their Independent Assessment of AI R&D Acceleration at Anthropic. They estimate that Anthropic “is likely improving the capabilities of their models on well-specified tasks at around twice the rate they did between March 2024 and October 2025.” They also add that “there is a significant risk that further capabilities progress could lead to even faster acceleration.” This assessment implies that timelines to ASI could be very short. A naive forecast based on this information says that we will get ASI within a year.

One of the key data points that informed METR's analysis was a 1.9 times increase in the improvement rate of AECI, Anthropic's internal version of the Epoch Capabilities Index. This is particularly notable because METR estimates that the majority of the acceleration, maybe 80%, is from AI contributions, meaning that we could be seeing the start of an RSI loop causing superexponential growth in capabilities, as measured by AECI.

However, an alternative possibility is that Anthropic's AIs might be assisting with ML research in a way that overfits to AECI such that this acceleration will not be sustained. METR gestures at this when they note that AECI's focus on verifiable tasks is [...]

---

Outline:

(01:49) Second-order AECI might be overfit

(05:58) Why ML research is the crux

(07:46) Conclusion

---

First published:
November 11th, 2026

Source:
https://www.lesswrong.com/posts/7znBtiPuQybFLxjmj/do-verifiable-metrics-overestimate-rsi

---

Narrated by TYPE III AUDIO.

---

Images from the article:

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.

Weitere Episoden von „LessWrong (30+ Karma)“