Today on Talk Python: What really happens when your data work outgrows your laptop. Matthew Rocklin, creator of Dask and cofounder of Coiled, and Nat Tabris a staff software engineer at Coiled join me to unpack the messy truth of cloud-scale Python. During the episode we actually spin up a 1,000 core cluster from a notebook, twice! We also discuss picking between pandas and Polars, when GPUs help, and how to avoid surprise bills. Real lessons, real tradeoffs, shared by people who have built this stuff. Stick around. 
 
Episode sponsors 
 
<a href='https://talkpython.fm/seer'>Seer: AI Debugging, Code TALKPYTHON</a>
<a href='https://talkpython.fm/training'>Talk Python Courses</a> 
 
<h2 class="links-heading">Links from the show</h2>
<div>Matthew Rocklin: <a href="https://x.com/mrocklin?featured_on=talkpython" target="_blank" >@mrocklin</a> 
Nat Tabris: <a href="https://tabris.us?featured_on=talkpython" target="_blank" >tabris.us</a> 
 
Dask: <a href="https://www.dask.org?featured_on=talkpython" target="_blank" >dask.org</a> 
Coiled: <a href="https://coiled.io?featured_on=talkpython" target="_blank" >coiled.io</a> 
Watch this episode on YouTube: <a href="https://www.youtube.com/watch?v=omBibVGLzyo" target="_blank" >youtube.com</a> 
Episode #519 deep-dive: <a href="https://talkpython.fm/episodes/show/519/data-science-cloud-lessons-at-scale#takeaways-anchor" target="_blank" >talkpython.fm/519</a> 
Episode transcripts: <a href="https://talkpython.fm/episodes/transcript/519/data-science-cloud-lessons-at-scale" target="_blank" >talkpython.fm</a> 
Developer Rap Theme Song: Served in a Flask: <a href="https://talkpython.fm/flasksong" target="_blank" >talkpython.fm/flasksong</a> 
 
--- Stay in touch with us --- 
Subscribe to Talk Python on YouTube: <a href="https://talkpython.fm/youtube" target="_blank" >youtube.com</a> 
Talk Python on Bluesky: <a href="https://bsky.app/profile/talkpython.fm" target="_blank" >@talkpython.fm at bsky.app</a> 
Talk Python on Mastodon: <a href="https://fosstodon.org/web/@talkpython" target="_blank" >talkpython</a> 
Michael on Bluesky: <a href="https://bsky.app/profile/mkennedy.codes?featured_on=talkpython" target="_blank" >@mkennedy.codes at bsky.app</a> 
Michael on Mastodon: <a href="https://fosstodon.org/web/@mkennedy" target="_blank" >mkennedy</a> </div>

Podurama

Home

Trending

Personal

Your Podcasts

New Episodes

My Files

Favourite Episodes

Tags (Folders)

Recently Played

Bookmarks

Followed Playlists

#519: Data Science Cloud Lessons at Scale

Talk Python To Me

AI Chapters

AI Insights

Reviews