The DuckLake Lakehouse Format // MLOps Podcast #339 with Hannes Mühleisen, Co-founder and CEO of DuckDB Labs.Join the Community: <a href="https://go.mlops.community/YTJoinIn" target="_blank" rel="ugc noopener noreferrer">https://go.mlops.community/YTJoinIn</a>Get the newsletter: <a href="https://go.mlops.community/YTNewsletter" target="_blank" rel="ugc noopener noreferrer">https://go.mlops.community/YTNewsletter</a>// AbstractManaging data on Object Stores has been a painful affair. Users had to choose between data swamp chaos or a maze of metadata files with catalog servers on top. DuckLake is a new paradigm for managing data on object stores: First, it uses classical SQL data management systems to manage metadata. Second, actual data is stored in Parquet files on pretty arbitrary storage. Third, processing queries is done client-side, or anywhere really. DuckDB is the first system to integrate with DuckLake using an extension with the same name. Conceptually, DuckLake enables central control over truth while decentralizing compute and storage entirely. DuckLake turns data warehouse architecture upside down by departing from the integrated metadata/compute layer towards a fully disconnected operation with only centralized metadata. For the first time, DuckLake allows a “multi-player” experience with DuckDB, where computation stays fully local, but transactional control is centralized.// BioHannes Mühleisen 🔈 is a creator of the DuckDB database management system and Co-founder and CEO of DuckDB Labs. He is a senior researcher at the Centrum Wiskunde & Informatica (CWI) in Amsterdam. He is also Professor of Data Engineering at Radboud University Nijmegen.// Related LinksWebsite: <a href="https://hannes.muehleisen.org" target="_blank" rel="ugc noopener noreferrer">https://hannes.muehleisen.org</a>~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: <a href="https://go.mlops.community/TYExplore" target="_blank" rel="ugc noopener noreferrer">https://go.mlops.community/TYExplore</a>Join our Slack community [<a href="https://go.mlops.community/slack" target="_blank" rel="ugc noopener noreferrer">https://go.mlops.community/slack</a>]Follow us on X/Twitter [@mlopscommunity](<a href="https://x.com/mlopscommunity" target="_blank" rel="ugc noopener noreferrer">https://x.com/mlopscommunity</a>) or [LinkedIn](<a href="https://go.mlops.community/linkedin" target="_blank" rel="ugc noopener noreferrer">https://go.mlops.community/linkedin</a>)] Sign up for the next meetup: [<a href="https://go.mlops.community/register" target="_blank" rel="ugc noopener noreferrer">https://go.mlops.community/register</a>]MLOps Swag/Merch: [<a href="https://shop.mlops.community/" target="_blank" rel="ugc noopener noreferrer">https://shop.mlops.community/</a>]Connect with Demetrios on LinkedIn: <a href="https://www.linkedin.com/in/dpbrinkm/" target="_blank" rel="ugc noopener noreferrer">/dpbrinkm</a>Connect with Hudson on LinkedIn: <a href="https://www.linkedin.com/in/hfmuehleisen/" target="_blank" rel="ugc noopener noreferrer">/hfmuehleisen</a>

Podurama

Home

Trending

Personal

Your Podcasts

New Episodes

My Files

Favourite Episodes

Tags (Folders)

Recently Played

Bookmarks

Followed Playlists

The DuckLake Lakehouse Format // Hannes Mühleisen // #339

MLOps.community

AI Chapters

AI Insights

Reviews