Since August, a team within METR has worked with internal Anthropic information to assess whether AI itself is accelerating AI development.
We are now publishing a report summarizing the results of this risk assessment.
0
6 comments
We are now publishing a report summarizing the results of this risk assessment.
An “acceleration” would mean that AI capabilities increase even faster than their historical trend.
Our assessment studied three questions: (1) is acceleration occurring, (2) is it attributable to AI, and (3) are there blockers to near future growth? https://x.com/METR_Evals/status/2110519549028389128?a=ixA1w9PjCK1lrLEbGH0&s=20
Anthropic shared extensive evidence across its AI R&D pipeline, from pretraining to RL, including key details like estimates of algorithmic progress over time. We found this nonpublic evidence highly informative about AI R&D acceleration. https:/
We submitted a ~100-page full report on our assessment to Anthropic. For the public version, Anthropic redacted a majority of the evidence we found most informative. As a consequence, the public must rely on our judgment more than we consider ideal.
This report shares our three subjective conclusions about risk: