
#251 – The UK's former head AI safety scientist on how to solve alignment before superintelligence arrives | Geoffrey Irving
When should governments slow the race toward superintelligence? According to Geoffrey Irving, the careful answer is sometime in the past. The useful answer is now. Geoffrey — formerly a safety researcher at OpenAI and Google DeepMind and chief scientist at the UK AI Security Institute — expects full-blown superintelligence in roughly two to three years. *** Want to work with Geoffrey to help align superintelligence? Resolution is hiring! https://80k.info/work-at-resolution *** The leading AI companies all have broadly similar plans for keeping superintelligence under control: Train models to have good character Use increasingly capable AIs to supervise other AIs Monitor them closely for signs of deception or scheming Geoffrey thinks that combination could work. The alarming part is that nobody has a strong argument that it will. He expects a crucial “phase shift” as models move beyond human intelligence: Below that threshold, humans can usually tell whether a model’s work is good and correct its mistakes. Above it, the models themselves will increasingly determine the feedback used to train their successors. In this episode, Geoffrey and new host Tom Reed explore what might go wrong with the companies’ plans; why Geoffrey’s new nonprofit, Resolution, is pursuing a portfolio of neglected research bets; and whether governments should slow AI development while we work out which methods can actually be trusted. This episode was recorded on June 29, 2026.
Publisher
80,000 Hours Podcast
Link
80000hours.org/podcast/episodes/geoffrey-irving-superintelligence-alignment-theory/?utm_campaign=podcast__geoffrey-irving&utm_source=80000+Hours+Podcast&utm_medium=podcast
Published
August 11, 2026
Duration
2h 2m
Format
Podcast
Category
Lifestyle · Education
Source
RSS feed
Host
The 80,000 Hours team
80,000 Hours Podcast
@80000hourspodcast
#uksformerhead #solvealignment #superintelligencearrives
