Constructing and Judging Modern Agentic Workflows

Episode 302

0:00-58:30

How can you improve your LLM agent systems through specification enrichment? What are the advantages of having an LLM act as a judge within an agent system? This week on the show, Senior IEEE Member and Quality Engineer Suneet Malhotra joins us to discuss building and evaluating agentic architecture. Suneet Malhotra is an independent practitioner-researcher with 18 years of experience in Quality Engineering (QE) and test automation for consumer-scale platforms. He discusses building specification-enrichment loops, monitoring performance, and using Cohen’s kappa to measure agreement between LLM judgments. Suneet is currently publishing multiple papers that are under peer review on these topics. He also provides links to his work and GitHub projects if you want to experiment with these concepts and methods yourself. Quick Survey: Get more out of the podcast show notes Video Course Spotlight: Testing MCP Servers With a Python MCP Client Learn how to build a Python MCP client that tests MCP servers from your terminal. List their tools, prompts, and resources, then call each one. Topics: 00:00:00 – Introduction 00:00:56 – Survey: RP Podcast show notes 00:02:11 – How did you get into testing? 00:05:04 – Has working for large public-facing corporations changed how you approach testing?

Publisher

The Real Python Podcast

Link

realpython.com/podcasts/rpp/302/

Published

July 10, 2026

Duration

59 min

Format

Podcast

Category

Issues · Tech News

Source

RSS feed

Host

Real Python

TR

The Real Python Podcast

@realpythonpodcast

#constructing #judgingmodernagentic

The Nile