Intro topic: Asymmetric ReturnsNews/Links:<ul><li>NanoChat by Andrej Karpathy<ul><li><a href="https://github.com/karpathy/nanochat">https://github.com/karpathy/nanochat</a></li></ul></li><li>Pydantic AI<ul><li><a href="https://www.marktechpost.com/2025/03/25/pydanticai-advancing-generative-ai-agent-development-through-intelligent-framework-design/">https://www.marktechpost.com/2025/03/25/pydanticai-advancing-generative-ai-agent-development-through-intelligent-framework-design/</a></li></ul></li><li>1000th Starlink this year<ul><li><a href="https://spaceflightnow.com/2025/05/16/live-coverage-spacex-plans-morning-launch-of-starlink-satellites-from-california/">https://spaceflightnow.com/2025/05/16/live-coverage-spacex-plans-morning-launch-of-starlink-satellites-from-california/</a></li></ul></li><li>ChatGPT Apps SDK<ul><li><a href="https://openai.com/index/introducing-apps-in-chatgpt/">https://openai.com/index/introducing-apps-in-chatgpt/</a></li></ul></li></ul>Book of the Show<ul><li>Patrick<ul><li>The Will of the Many by James Islington<ul><li><a href="https://amzn.to/43IfU8Q">https://amzn.to/43IfU8Q</a></li></ul></li></ul></li><li>Jason<ul><li>Interview with DHH (Founder of Ruby on Rails)<ul><li><a href="https://www.youtube.com/watch?v=vagyIcmIGOQ">https://www.youtube.com/watch?v=vagyIcmIGOQ</a></li></ul></li></ul></li></ul>Patreon Plug <a href="https://www.patreon.com/programmingthrowdown?ty=h">https://www.patreon.com/programmingthrowdown?ty=h</a>Tool of the Show<ul><li>Patrick<ul><li>Factorio<ul><li><a href="https://www.factorio.com/">https://www.factorio.com/</a> </li></ul></li></ul></li><li>Jason<ul><li><a href="http://nip.io">nip.io</a> </li></ul></li></ul>Topic: Workflow Orchestrators<ul><li>Why<ul><li>Batch jobs (embarrassingly parallel)</li><li>Long-running tasks (e.g. transcoding video)</li><li>Checkpointing/resuming</li></ul></li><li>How<ul><li>Message Queues</li><li>Containerization</li><li>Worker Pools & Autoscaling</li><li>History & Backfill</li></ul></li><li>Steps to run workflows:<ul><li>Containerize the workflow definition and send to the cloud</li><li>Containerize all the individual tasks</li><li>Submit job(s)</li></ul></li><li>Examples<ul><li>Airflow<ul><li>Legacy but dominant</li></ul></li><li>Dagster<ul><li>Great UX for python developers</li></ul></li><li>Temporal: <a href="https://temporal.io/">https://temporal.io/</a><ul><li>The new hotness</li></ul></li><li>Ray<ul><li>Low-level but very powerful</li></ul></li><li>Kubeflow<ul><li>Designed for ML workflows, integrated dashboard</li></ul></li></ul></li></ul>

 <a href="https://www.patreon.com/programmingthrowdown" rel="payment" title="★ Support this podcast on Patreon ★">★ Support this podcast on Patreon ★</a>

Podurama

Home

Trending

Personal

Your Podcasts

New Episodes

My Files

Favourite Episodes

Tags (Folders)

Recently Played

Bookmarks

Followed Playlists

185: Workflow Orchestrators

Programming Throwdown

AI Chapters

AI Insights

Reviews