#251 – The UK's former head AI safety scientist on how to solve alignment before superintelligence arrives | Geoffrey Irving

0:00-2:02:16

When should governments slow the race toward superintelligence? According to Geoffrey Irving, the careful answer is sometime in the past. The useful answer is now. Geoffrey — formerly a safety researcher at OpenAI and Google DeepMind and chief scientist at the UK AI Security Institute — expects full-blown superintelligence in roughly two to three years. *** Want to work with Geoffrey to help align superintelligence? Resolution is hiring! https://80k.info/work-at-resolution *** The leading AI companies all have broadly similar plans for keeping superintelligence under control: Train models to have good character Use increasingly capable AIs to supervise other AIs Monitor them closely for signs of deception or scheming Geoffrey thinks that combination could work. The alarming part is that nobody has a strong argument that it will. He expects a crucial “phase shift” as models move beyond human intelligence: Below that threshold, humans can usually tell whether a model’s work is good and correct its mistakes. Above it, the models themselves will increasingly determine the feedback used to train their successors. In this episode, Geoffrey and new host Tom Reed explore what might go wrong with the companies’ plans; why Geoffrey’s new nonprofit, Resolution, is pursuing a portfolio of neglected research bets; and whether governments should slow AI development while we work out which methods can actually be trusted. This episode was recorded on June 29, 2026.

Publisher

80,000 Hours Podcast

Link

80000hours.org/podcast/episodes/geoffrey-irving-superintelligence-alignment-theory/?utm_campaign=podcast__geoffrey-irving&utm_source=80000+Hours+Podcast&utm_medium=podcast

Published

August 11, 2026

Duration

2h 2m

Format

Podcast

Category

Lifestyle · Education

Source

RSS feed

Host

The 80,000 Hours team

8H

80,000 Hours Podcast

@80000hourspodcast

#uksformerhead #solvealignment #superintelligencearrives

The Nile