Dwarkesh Patel on AI benchmarks
From Dwarkesh Patel - AI Timelines, Productivity & Global Stagnation · · Summation with Auren Hoffman
“If we keep passing through these benchmarks while at the same time not unlocking the economic value that is implied by AGI, which at the minimum should be able to do white collar work, which is worth tens of trillions of dollars every year in terms of wages paid to white collar workers. If we're not unlocking that while at the same time moving through these benchmarks, then it does make sense to shift the goal post in the sense of asking well what is the remaining bottleneck that we didn't previously identify which explains their lack of usefulness.”
On , Dwarkesh Patel, CEO and Founder at The Dwarkesh Podcast, spoke about AI benchmarks during Dwarkesh Patel - AI Timelines, Productivity & Global Stagnation on Summation with Auren Hoffman.
About Dwarkesh Patel
Dwarkesh Patel, founder and host of The Dwarkesh Podcast, has been a frequent guest on other programs and published episodes with researchers and executives. On Triggernometry, Patel discussed the potential societal effects of artificial intelligence, stating that he finds the prospect of mass job displacement "scary" and that AI could make authoritarian surveillance far more efficient because "a lot of the reasons that government has not been as authoritarian as it has in the past is that it just physically not been possible." He also said that while he is "a very libertarian person by inclination," he believes the dynamic of capital replacing labor "justifies a huge amount of redistribution." Regarding AI sentience, Patel said he "genuinely doesn't know" whether current systems are sentient, and argued that future AI systems will need to have "their own values" and that a "constitutional convention" should be held to define those values. Patel has also hosted guests including former Google DeepMind researcher Eric Jang, who discussed rebuilding AlphaGo and the lessons it offers for self-play and reinforcement learning; Harvard geneticist David Reich, who presented new findings showing accelerated natural selection during the Bronze Age; Nvidia CEO Jensen Huang, who defended Nvidia's moat by stating that "the transformation from electrons to tokens is such an incredible journey" and is "hard to completely commoditize"; and research fellow Michael Nielsen, with whom Patel explored how scientific progress is recognized and how that question applies to AI-driven discovery. Patel has described the improvement of AI models as "very fast" and observed a "huge discrepancy between what people are seeing in Silicon Valley and what people are observing outside."