High-Efficiency Diffusion Models for On-Device Image Generation and Editing with Hung Bui

Episode 753

0:00-52:23

In this episode, Hung Bui, Technology Vice President at Qualcomm, joins us to explore the latest high-efficiency techniques for running generative AI, particularly diffusion models, on-device. We dive deep into the technical challenges of deploying these models, which are powerful but computationally expensive due to their iterative sampling process. Hung details his team's work on SwiftBrush and SwiftEdit, which enable high-quality text-to-image generation and editing in a single inference step. He explains their novel distillation framework, where a multi-step teacher model guides the training of an efficient, single-step student model. We explore the architecture and training, including the use of a secondary 'coach' network that aligns the student's denoising function with the teacher's, allowing the model to bypass the iterative process entirely. Finally, we discuss how these efficiency breakthroughs pave the way for personalized on-device agents and the challenges of running reasoning models with techniques like inference-time scaling under a fixed compute budget.

Publisher

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

Link

twimlai.com/podcast/twimlai/high-efficiency-diffusion-models-for-on-device-image-generation-and-editing/

Published

October 28, 2025

Duration

52 min

Format

Podcast

Category

Issues · Tech News

Source

RSS feed

Host

Sam Charrington

TT

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

@twimlai

#efficiencydiffusionmodels #deviceimagegeneration #hungbui

The Nile