Large language models and chat-based AIs are kind of mind blowing at the moment. Many of us are playing with them for working on code or just as a fun alternative to search. But others of us are building applications with AI at the core. And when doing that, the slightly unpredictable nature and probabilistic nature of LLMs make writing and testing Python code very tricky. Enter promptimize from Maxime Beauchemin and Preset. It's a framework for non-deterministic testing of LLMs inside our applications. Let's dive inside the AIs with Max. 
 
Links from the show 
 
<div>Max on Twitter: <a href="https://twitter.com/mistercrunch" target="_blank" rel="noopener">@mistercrunch</a> 
Promptimize: <a href="https://github.com/preset-io/promptimize" target="_blank" rel="noopener">github.com</a> 
Introducing Promptimize ("the blog post"): <a href="https://preset.io/blog/introducing-promptimize/" target="_blank" rel="noopener">preset.io</a> 
Preset: <a href="https://preset.io" target="_blank" rel="noopener">preset.io</a> 
Apache Superset: Modern Data Exploration Platform episode: <a href="https://talkpython.fm/episodes/show/382/apache-superset-modern-data-exploration-platform" target="_blank" rel="noopener">talkpython.fm</a> 
ChatGPT: <a href="https://chat.openai.com/" target="_blank" rel="noopener">chat.openai.com</a> 
LeMUR: <a href="https://www.assemblyai.com/blog/lemur-early-access/" target="_blank" rel="noopener">assemblyai.com</a> 
Microsoft Security Copilot: <a href="https://blogs.microsoft.com/blog/2023/03/28/introducing-microsoft-security-copilot-empowering-defenders-at-the-speed-of-ai/" target="_blank" rel="noopener">blogs.microsoft.com</a> 
AutoGPT: <a href="https://github.com/Significant-Gravitas/Auto-GPT" target="_blank" rel="noopener">github.com</a> 
Midjourney: <a href="https://www.midjourney.com" target="_blank" rel="noopener">midjourney.com</a> 
Midjourney generated pytest tips thumbnail: <a href="https://cdn-podcast.talkpython.fm/episodes/youtube_image/qQ6b7OwT124/pytest-tips-and-tricks-for-better-testing.jpg?v=1" target="_blank" rel="noopener">talkpython.fm</a> 
Midjourney generated radio astronomy thumbnail: <a href="https://cdn-podcast.talkpython.fm/episodes/youtube_image/2_-YUBWtWbU/testing-in-radio-astronomy-with-python-and-pytest.jpg?v=1" target="_blank" rel="noopener">talkpython.fm</a> 
Prompt engineering: <a href="https://learnprompting.org" target="_blank" rel="noopener">learnprompting.org</a> 
Michael's ChatGPT result for scraping Talk Python episodes: <a href="https://gist.github.com/mikeckennedy/7ca030d6ddda1570f56dacf44e845f40" target="_blank" rel="noopener">github.com</a> 
Apache Airflow: <a href="https://github.com/apache/airflow" target="_blank" rel="noopener">github.com</a> 
Apache Superset: <a href="https://github.com/apache/superset" target="_blank" rel="noopener">github.com</a> 
Tay AI Goes Bad: <a href="https://www.theverge.com/2016/3/24/11297050/tay-microsoft-chatbot-racist" target="_blank" rel="noopener">theverge.com</a> 
LangChain: <a href="https://github.com/hwchase17/langchain" target="_blank" rel="noopener">github.com</a> 
LangChain Cookbook: <a href="https://github.com/gkamradt/langchain-tutorials/blob/main/LangChain%20Cookbook%20Part%201%20-%20Fundamentals.ipynb" target="_blank" rel="noopener">github.com</a> 
Promptimize Python Examples: <a href="https://github.com/preset-io/promptimize/blob/main/examples/python_examples.py" target="_blank" rel="noopener">github.com</a> 
TLDR AI: <a href="https://tldr.tech/ai" target="_blank" rel="noopener">tldr.tech</a> 
AI Tool List: <a href="https://www.futuretools.io" target="_blank" rel="noopener">futuretools.io</a> 
Watch this episode on YouTube: <a href="https://www.youtube.com/watch?v=RN3vlCLs-c8" target="_blank" rel="noopener">youtube.com</a> 
Episode transcripts: <a href="https://talkpython.fm/episodes/transcript/417/test-driven-prompt-engineering-for-llms-with-promptimize" target="_blank" rel="noopener">talkpython.fm</a> 
 
--- Stay in touch with us --- 
Subscribe to us on YouTube: <a href="https://talkpython.fm/youtube" target="_blank" rel="noopener">youtube.com</a> 
Follow Talk Python on Mastodon: <a href="https://fosstodon.org/web/@talkpython" target="_blank" rel="noopener">talkpython</a> 
Follow Michael on Mastodon: <a href="https://fosstodon.org/web/@mkennedy" target="_blank" rel="noopener">mkennedy</a> </div> 
Sponsors 
<a href='https://talkpython.fm/done-with-pycharm'>PyCharm</a>
<a href='https://talkpython.fm/compiler'>RedHat</a>
<a href='https://talkpython.fm/training'>Talk Python Training</a>

Podurama

Home

Trending

Personal

Your Podcasts

New Episodes

My Files

Favourite Episodes

Tags (Folders)

Recently Played

Bookmarks

Followed Playlists

#417: Test-Driven Prompt Engineering for LLMs with Promptimize

Talk Python To Me

AI Chapters

AI Insights

Reviews