
#255 – Will AI take power — or will humans use it to take power first? With Katja Grace and Tom Davidson
In our first-ever debate, we asked two leading AI risk researchers which catastrophe we should fear most: misaligned AI seizing control from humans, or a small group of humans using AI to seize power. We got very different answers. But when the conversation turned to what to actually do, they agreed on a surprising amount. Katja Grace — one of the founders of AI Impacts, known for some of the world’s largest surveys of machine learning researchers, and one of TIME‘s 100 most influential people in AI in 2024 — argues AI takeover is both likelier and worse. Tom Davidson — senior research fellow at Forethought and author of leading work on AI-enabled coups — thinks human power grabs are a comparable risk that deserves far more attention, not least because the people leading countries and top AI companies “are often people who have been willing to seek power.” Yet both land on slowing down. As Katja puts it, “If you make a bunch of creatures that can overpower you and outwit you in every way and put them out in the world, you’re going to run into trouble one way or another.” Tom calls pausing “a pretty robustly good thing to do.” But Tom warns that a badly designed pause could hand one person the power to decide which AI companies get to build what. Picture a president who approves or blocks new models case by case, and waves through the one model that’s helpful only to them.
Publisher
80,000 Hours Podcast
Link
80000hours.org/podcast/episodes/katja-grace-vs-tom-davidson-ai-risk-debate/?utm_campaign=podcast__katja-grace-tom-davidson&utm_source=80000+Hours+Podcast&utm_medium=podcast
Published
September 29, 2026
Duration
1h 29m
Format
Podcast
Category
Lifestyle · Education
Source
RSS feed
Host
The 80,000 Hours team
80,000 Hours Podcast
@80000hourspodcast
#humansuse #katjagrace #tomdavidson
