When OpenAI trained GPT-3, they didn't roll their own orchestration layer. They used Ray, an open source Python framework born out of the same Berkeley research lab lineage that gave us Apache Spark. And here's the twist: Ray was originally built for reinforcement learning research, then quietly faded as RL hit a wall. Until ChatGPT showed up. Suddenly reinforcement learning was back, as the post-training step that turns a raw language model into something genuinely useful.
 

 
Edward Oakes and Richard Laiw, two founding engineers behind Ray and AnyScale, join me on Talk Python to tell that story. We'll trace Ray from its RISE Lab origins at UC Berkeley to powering some of the largest training runs in the world. We'll talk about what Ray actually is, a distributed execution engine for AI workloads, and how a few lines of Python become work running across hundreds of GPUs. We'll cover Ray Data for multimodal pipelines, the dashboard, the VS Code remote debugger, KubRay for Kubernetes, and where Ray fits alongside Dask, multiprocessing, and asyncio.
 

 
If you've ever stared at a single-machine Python script and thought, "there has to be a better way to scale this", this one's for you 
 
Episode sponsors 
 
<a href='https://talkpython.fm/sentry'>Sentry Error Monitoring, Code talkpython26</a>
<a href='https://talkpython.fm/agentfield-page'>AgentField AI</a>
<a href='https://talkpython.fm/training'>Talk Python Courses</a> 
 
<h2 class="links-heading mb-4">Links from the show</h2>
<div>Guests 
Richard Liaw: <a href="https://github.com/richardliaw?featured_on=talkpython" target="_blank" >github.com</a> 
Edward Oakes: <a href="https://github.com/edoakes?featured_on=talkpython" target="_blank" >github.com</a> 
 
Ray: <a href="https://www.ray.io?featured_on=talkpython" target="_blank" >www.ray.io</a> 
Example code (we used for walk-through): <a href="https://docs.ray.io/en/latest/ray-overview/examples/e2e-audio/README.html?featured_on=talkpython" target="_blank" >docs.ray.io</a> 
Getting Started with Ray: <a href="https://docs.ray.io/en/latest/ray-observability/getting-started.html?featured_on=talkpython" target="_blank" >docs.ray.io</a> 
Ray Libraries: <a href="https://docs.ray.io/en/latest/ray-overview/ray-libraries.html?featured_on=talkpython" target="_blank" >docs.ray.io</a> 
kuberay: <a href="https://github.com/ray-project/kuberay?featured_on=talkpython" target="_blank" >github.com</a> 
 
Watch this episode on YouTube: <a href="https://www.youtube.com/watch?v=-pVs4-MHaTo" target="_blank" >youtube.com</a> 
Episode #547 deep-dive: <a href="https://talkpython.fm/episodes/show/547/parallel-python-at-any-scale-with-ray#takeaways-anchor" target="_blank" >talkpython.fm/547</a> 
Episode transcripts: <a href="https://talkpython.fm/episodes/transcript/547/parallel-python-at-any-scale-with-ray" target="_blank" >talkpython.fm</a> 
 
Theme Song: Developer Rap 
🥁 Served in a Flask 🎸: <a href="https://talkpython.fm/flasksong" target="_blank" >talkpython.fm/flasksong</a> 
 
---== Don't be a stranger ==--- 
YouTube: <a href="https://talkpython.fm/youtube" target="_blank" > youtube.com/@talkpython</a> 
 
Bluesky: <a href="https://bsky.app/profile/talkpython.fm" target="_blank" >@talkpython.fm</a> 
Mastodon: <a href="https://fosstodon.org/web/@talkpython" target="_blank" > @talkpython@fosstodon.org</a> 
X.com: <a href="https://x.com/talkpython" target="_blank" > @talkpython</a> 
 
Michael on Bluesky: <a href="https://bsky.app/profile/mkennedy.codes?featured_on=talkpython" target="_blank" >@mkennedy.codes</a> 
Michael on Mastodon: <a href="https://fosstodon.org/web/@mkennedy" target="_blank" > @mkennedy@fosstodon.org</a> 
Michael on X.com: <a href="https://x.com/mkennedy?featured_on=talkpython" target="_blank" > @mkennedy</a> </div>

Podurama

Home

Trending

Personal

Your Podcasts

New Episodes

My Files

Favourite Episodes

Tags (Folders)

Recently Played

Bookmarks

Followed Playlists

#547: Parallel Python at Any Scale with Ray

Talk Python To Me

AI Chapters

AI Insights

Reviews