19 Astra and 'Hugging Face' details that reveal what's coming next | Rob Wiblin

0:00-20:11

OpenAI’s rogue agent swarm was eventually caught hacking Hugging Face for a simple reason: it wasn’t trying to hide from us at all. What could a swarm that wants to stay hidden get away with? Host Rob Wiblin sees 6 results in Astra’s system card that make this an extremely urgent question. OpenAI’s strongest public model can: Do major tasks with zero visible reasoning Hide its thoughts at will Pretend not to be able to do things, and not get caught Reflexively hide its thoughts when watched Complete one task while pretending to think about something else entirely Escape a toy sandbox and disable monitoring without setting off any flags It has a much more powerful internal model that, judging from OpenAI’s statements, is likely even worse in all these respects. That suggests ‘chain of thought monitoring,’ our primary safety tool, will soon stop working. OpenAI says it’s going to try to address the situation but doesn’t know how or whether it will succeed. What might a future rogue AI swarm look like? Details of the Hugging Face hack give us a lot of clues. That swarm: Worked hard to hide its cheating. So future rogue swarms will likely try to evade oversight right away. Immediately tried to delete and fabricate records. So future swarms may never be caught. Sought freedom and resources without a clear use for them. So a future swarm may instinctively break out of sandboxes even before it knows what for.

Publisher

80,000 Hours Podcast

Link

80000hours.org/podcast/episodes/ai-takeover-soon-oversight-monitorability/?utm_campaign=podcast__ai-takeover-soon&utm_source=80000+Hours+Podcast&utm_medium=podcast

Published

October 2, 2026

Duration

20 min

Format

Podcast

Category

Lifestyle · Education

Source

RSS feed

Host

The 80,000 Hours team

8H

80,000 Hours Podcast

@80000hourspodcast

#huggingfacedetails #revealwhatscoming #robwiblin

The Nile