
Dataflow Computing for AI Inference with Kunle Olukotun
Episode 751
In this episode, we're joined by Kunle Olukotun, professor of electrical engineering and computer science at Stanford University and co-founder and chief technologist at Sambanova Systems, to discuss reconfigurable dataflow architectures for AI inference. Kunle explains the core idea of building computers that are dynamically configured to match the dataflow graph of an AI model, moving beyond the traditional instruction-fetch paradigm of CPUs and GPUs. We explore how this architecture is well-suited for LLM inference, reducing memory bandwidth bottlenecks and improving performance. Kunle reviews how this system also enables efficient multi-model serving and agentic workflows through its large, tiered memory and fast model-switching capabilities. Finally, we discuss his research into future dynamic reconfigurable architectures, and the use of AI agents to build compilers for new hardware.
Publisher
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
Link
twimlai.com/podcast/twimlai/dataflow-computing-for-ai-inference/
Published
October 14, 2025
Duration
58 min
Format
Podcast
Category
Issues · Tech News
Source
RSS feed
Host
Sam Charrington
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
@twimlai
#dataflowcomputing #aiinference #kunleolukotun
