DuckLake: The Lakehouse That's Just SQL and Parquet

Episode 562

0:00-1:11:09

How many files does your query read before it reads any data? On some data lakes, you go through JSON and metadata files first, just to learn which Parquet files matter. DuckLake asks one SQL question instead. The metadata lives in a real database. The data stays in plain Parquet. That's the entire format. Pedro Holanda joined DuckDB in 2018, when it was still a research prototype at CWI. He's the lead DuckLake developer. Guillermo Sanchez Dionis works on DuckLake and the new Quack protocol. With Quack as the catalog, DuckLake handles 200 transactions a second under heavy contention. No other open table format comes close.

Publisher

Talk Python To Me

Link

talkpython.fm/episodes/show/562/ducklake-the-lakehouse-thats-just-sql-and-parquet

Published

September 10, 2026

Duration

1h 11m

Format

Podcast

Category

Issues · Tech News

Source

RSS feed

Host

Michael Kennedy

TP

Talk Python To Me

@talkpythontome

#ducklake #lakehousethats #parquet

The Nile