In this episode, I’m talking with Vincent Warmerdam about treating LLMs as just another API in your Python app, with clear boundaries, small focused endpoints, and good monitoring. We’ll dig into patterns for wrapping these calls, caching and inspecting responses, and deciding where an LLM API actually earns its keep in your architecture. 
 
Episode sponsors 
 
<a href='https://talkpython.fm/seer'>Seer: AI Debugging, Code TALKPYTHON</a>
<a href='https://talkpython.fm/nordstellar'>NordStellar</a>
<a href='https://talkpython.fm/training'>Talk Python Courses</a> 
 
<h2 class="links-heading mb-4">Links from the show</h2>
<div>Vincent on X: <a href="https://x.com/fishnets88?featured_on=talkpython" target="_blank" >@fishnets88</a> 
Vincent on Mastodon: <a href="https://fosstodon.org/@koaning" target="_blank" >@koaning</a> 
 
LLM Building Blocks for Python Co-urse: <a href="https://training.talkpython.fm/courses/llm-building-blocks-for-python" target="_blank" >training.talkpython.fm</a> 
Top Talk Python Episodes of 2024: <a href="https://talkpython.fm/blog/posts/top-talk-python-podcast-episodes-of-2024/" target="_blank" >talkpython.fm</a> 
LLM Usage - Datasette: <a href="https://llm.datasette.io/en/stable/usage.html?featured_on=talkpython" target="_blank" >llm.datasette.io</a> 
DiskCache - Disk Backed Cache (Documentation): <a href="https://grantjenks.com/docs/diskcache?featured_on=talkpython" target="_blank" >grantjenks.com</a> 
smartfunc - Turn docstrings into LLM-functions: <a href="https://github.com/koaning/smartfunc?featured_on=talkpython" target="_blank" >github.com</a> 
Ollama: <a href="https://ollama.com?featured_on=talkpython" target="_blank" >ollama.com</a> 
LM Studio - Local AI: <a href="https://lmstudio.ai?featured_on=talkpython" target="_blank" >lmstudio.ai</a> 
marimo - A Next-Generation Python Notebook: <a href="https://marimo.io?featured_on=talkpython" target="_blank" >marimo.io</a> 
Pydantic: <a href="https://pydantic.dev?featured_on=talkpython" target="_blank" >pydantic.dev</a> 
Instructor - Complex Schemas & Validation (Python): <a href="https://python.useinstructor.com/#complex-schemas-validation" target="_blank" >python.useinstructor.com</a> 
Diving into PydanticAI with marimo: <a href="https://www.youtube.com/watch?v=ujQjqqBka-8" target="_blank" >youtube.com</a> 
Cline - AI Coding Agent: <a href="https://cline.bot?featured_on=talkpython" target="_blank" >cline.bot</a> 
OpenRouter - The Unified Interface For LLMs: <a href="https://openrouter.ai?featured_on=talkpython" target="_blank" >openrouter.ai</a> 
Leafcloud: <a href="https://leaf.cloud?featured_on=talkpython" target="_blank" >leaf.cloud</a> 
OpenAI looks for its "Google Chrome" moment with new Atlas web browser: <a href="https://arstechnica.com/ai/2025/10/openais-new-atlas-web-browser-wants-to-let-you-chat-with-a-page/?featured_on=talkpython" target="_blank" >arstechnica.com</a> 
 
Watch this episode on YouTube: <a href="https://www.youtube.com/watch?v=t-ReN9jS9sQ" target="_blank" >youtube.com</a> 
Episode #528 deep-dive: <a href="https://talkpython.fm/episodes/show/528/python-apps-with-llm-building-blocks#takeaways-anchor" target="_blank" >talkpython.fm/528</a> 
Episode transcripts: <a href="https://talkpython.fm/episodes/transcript/528/python-apps-with-llm-building-blocks" target="_blank" >talkpython.fm</a> 
 
Theme Song: Developer Rap 
🥁 Served in a Flask 🎸: <a href="https://talkpython.fm/flasksong" target="_blank" >talkpython.fm/flasksong</a> 
 
---== Don't be a stranger ==--- 
YouTube: <a href="https://talkpython.fm/youtube" target="_blank" > youtube.com/@talkpython</a> 
 
Bluesky: <a href="https://bsky.app/profile/talkpython.fm" target="_blank" >@talkpython.fm</a> 
Mastodon: <a href="https://fosstodon.org/web/@talkpython" target="_blank" > @talkpython@fosstodon.org</a> 
X.com: <a href="https://x.com/talkpython" target="_blank" > @talkpython</a> 
 
Michael on Bluesky: <a href="https://bsky.app/profile/mkennedy.codes?featured_on=talkpython" target="_blank" >@mkennedy.codes</a> 
Michael on Mastodon: <a href="https://fosstodon.org/web/@mkennedy" target="_blank" > @mkennedy@fosstodon.org</a> 
Michael on X.com: <a href="https://x.com/mkennedy?featured_on=talkpython" target="_blank" > @mkennedy</a> </div>

Podurama

Home

Trending

Personal

Your Podcasts

New Episodes

My Files

Favourite Episodes

Tags (Folders)

Recently Played

Bookmarks

Followed Playlists

#528: Python apps with LLM building blocks

Talk Python To Me

AI Chapters

AI Insights

Reviews