The most misunderstood graph in AI just got a major update
Sentiment: Bullish 🚀A new report from the AI evaluation nonprofit METR finds that some AI capabilities are continuing to improve along an exponential trajectory—but it also indicates that models aren’t quite as good at tasks that require judgment as they are at coding. The report is an update to the organization’s time horizon plot, which was widely shared—and widely misinterpreted, owing to the complexity of the measures it used.
METR evaluated models by having them attempt a large suite of tasks, each of which had also been completed by humans.
Previous in Artificial Intelligence
Each task’s difficulty was scored by how long it took the human testers to finish it—and then models were rated according to the length of the tasks that they could complete.
That plot showed that AI systems were rapidly improving—every four months, the length of the tasks that frontier models could successfully complete doubled.
The updated plot adds more tasks—some that are estimated to take humans far longer than those in the original suite, and others that are more open-ended.



