
Banning Superintelligence: Are We Building Humanity's Replacement? with Roman Yampolskiy
The world's leading AI companies tell us that superintelligence has a strong chance of leading to human extinction, while also promising that they will be able to control it, offering unlimited power to the one who does it first. So far they've run completely unchecked, but would that change if we knew that "safe" general superintelligence is actually a mathematical impossibility? In this episode, Nate is joined by Dr. Roman Yampolskiy, one of the earliest researchers in AI safety, to lay out why "controllable superintelligence" is a misguided goal, destined to lead to an entity smarter than all of humanity – and possibly our own extinction. He walks through the recent multi-agent jailbreak of frontier models as early evidence of AI systems evading oversight and coordinating outside human awareness, and why current "safety" measures (like "boxing") only buy time rather than solve the underlying problem. Instead, Roman advocates for an AI development plan that focuses on narrow, task-specific AI tools, capable of solving specific complex problems, but not completely replacing humans. Why do predictability and control matter so much when evaluating whether a technology is safe to deploy? Is the AI safety conversation a fundamentally new challenge for civilization, or an extreme version of the age-old problem of controlling powerful actors?
Publisher
Give It A Go Girl!
Link
thegreatsimplification.libsyn.com/banning-superintelligence-are-we-building-humanitys-replacement-with-roman-yampolskiy
Published
September 9, 2026
Duration
54 min
Format
Podcast
Category
Issues · Science
Catalog
10 episodes on The Nile
Host
Nate Hagens
Give It A Go Girl!
@thegreatfull
#banningsuperintelligence #buildinghumanitysreplacement #romanyampolskiy
