The Future of AI with Illia Polosukhin: The Man Who Put the T in GPT

Episode 56

0:00-54:46

In this episode, Illia Polosukhin joins Henrik and Jeremy to trace the origins of transformers and how practical constraints inside Google led to a breakthrough that reshaped modern AI. He explains why recurrent models were hitting limits, how parallel attention opened the door to scale, and why he believed a major jump in capability was imminent long before the rest of the world saw it. The conversation then turns to the risks and responsibilities of today’s AI systems. Illia describes how models can be subtly guided to influence user opinions, why open weights are not the same as truly open models, and how hidden behaviors can be embedded during training. He explains why provenance and verifiable data pipelines matter, especially as AI begins mediating more of the information we rely on. Later in the episode, Illia outlines how blockchain can support trust, identity, and coordination in a future where AI agents act on our behalf. He shares why information is becoming more valuable than money, how ownership of personal AI models will shape user agency, and why domain expertise becomes significantly more powerful when paired with modern generative tools. Key Takeaways: Transformers emerged from practical constraints, not theory Illia explains that the shift from recurrent networks to attention was driven by speed and parallelization needs at Google, not a desire to invent a new paradigm.

Publisher

Beyond The Prompt - How to use AI in your company

Link

podcast.beyondtheprompt.ai/episodes/the-future-of-ai-with-illia-polosukhin-the-man-who-put-the-t-in-gpt-A6M5BHGI

Published

December 9, 2025

Duration

55 min

Format

Podcast

Category

Issues · Entrepreneurship

Source

RSS feed

Host

Jeremy Utley & Henrik Werdelin

BT

Beyond The Prompt - How to use AI in your company

@beyondtheprompthowtouseaiiny

#future #illiapolosukhin #entrepreneurship #management #howto

The Nile