Nobody Is Getting New Manager Training for Their AI Team - with Dan Klein, UC Berkeley

Episode 69

0:00-1:03:19

Dan Klein, professor at UC Berkeley and CTO at Scaled Cognition, explains that AI systems generate answers based on patterns in language rather than verified knowledge. This makes them highly capable across many tasks, but also means they can produce confident answers even when they are not fully accurate. He introduces the “jagged frontier,” where AI performs very well in some areas and less reliably in others. Because responses are fluent and convincing, it is often hard to see where those limits are, which makes it important to stay engaged when using these systems. The conversation also explores hallucinations as a natural part of generative systems. In some cases, this is what makes them valuable, especially for creative or open-ended tasks, while in other cases reliability becomes more important. Finally, Dan highlights that working effectively with AI is a skill. As more people start using these systems in their daily work, knowing how to guide them, evaluate outputs, and apply them in the right contexts becomes increasingly important. He also shares how his team at Scaled Cognition is tackling this challenge by building AI systems with fundamentally different architectures, focused on determinism and reliability — aiming to ensure systems follow rules, reflect underlying data accurately, and behave predictably in high-stakes, policy-driven use cases.

Publisher

Beyond The Prompt - How to use AI in your company

Link

podcast.beyondtheprompt.ai/episodes/nobody-is-getting-new-manager-training-for-their-ai-team-with-dan-klein-uc-berkeley-VtIcks_l

Published

April 15, 2026

Duration

1h 3m

Format

Podcast

Category

Issues · Entrepreneurship

Source

RSS feed

Host

Jeremy Utley & Henrik Werdelin

BT

Beyond The Prompt - How to use AI in your company

@beyondtheprompthowtouseaiiny

#managertraining #danklein #ucberkeley #entrepreneurship #management #howto

The Nile