You ask an AI a question and it answers with total confidence. Most of the time, a confidently wrong answer is just an annoyance. But what if the question is medical, and there's a real patient on the other end? In that world, a hallucination isn't a bug, it's a patient-safety event. Sumit Gundawar is a London-based software engineer who builds the clinical platform for a UK longevity and aesthetic-medicine clinic, and his whole argument is that in high-stakes AI, the model is the easy part. Earning trust is the real engineering. We dig into grounding, refusal logic, human-in-the-loop design, and the messy frontier of longevity and biohacking, plus a live demo of an assistant that refuses to answer when it can't back up the claim. Let's get into it. 
 
Episode sponsors 
 
<a href='https://talkpython.fm/sixfeetup'>Six Feet Up</a>
<a href='https://talkpython.fm/training'>Talk Python Courses</a> 
 
<h2 class="links-heading mb-4">Links from the show</h2>
<div>Guest 
Sumit Gundawar: <a href="https://www.linkedin.com/in/sumit-gundawar-759470129/?featured_on=talkpython" target="_blank" >linkedin.com</a> 
 
Course transcripts announcement: <a href="https://talkpython.fm/blog/posts/announcing-german-subtitles-on-courses/" target="_blank" >talkpython.fm/blog</a> 
 
Sumit Gundawar - JAX London Speaker: <a href="https://jaxlondon.com/speaker/sumit-gundawar/?featured_on=talkpython" target="_blank" >jaxlondon.com</a> 
Anthropic: <a href="https://anthropic.com/?featured_on=talkpython" target="_blank" >anthropic.com</a> 
OpenAI Platform: <a href="https://platform.openai.com/?featured_on=talkpython" target="_blank" >platform.openai.com</a> 
Anthropic: <a href="https://anthropic.com/?featured_on=talkpython" target="_blank" >anthropic.com</a> 
LangChain: <a href="https://langchain.com/?featured_on=talkpython" target="_blank" >langchain.com</a> 
OWASP: <a href="https://owasp.org/?featured_on=talkpython" target="_blank" >owasp.org</a> 
Pydantic: <a href="https://pydantic.dev/?featured_on=talkpython" target="_blank" >pydantic.dev</a> 
EU AI Act - Regulatory Framework: <a href="https://digital-strategy.ec.europa.eu/en/policies/regulatory-framework-ai?featured_on=talkpython" target="_blank" >digital-strategy.ec.europa.eu</a> 
HIPAA - HHS: <a href="https://www.hhs.gov/hipaa?featured_on=talkpython" target="_blank" >www.hhs.gov</a> 
NHS: <a href="https://www.nhs.uk/?featured_on=talkpython" target="_blank" >www.nhs.uk</a> 
Llama: <a href="https://llama.com/?featured_on=talkpython" target="_blank" >llama.com</a> 
Qwen - QwenLM on GitHub: <a href="https://github.com/QwenLM?featured_on=talkpython" target="_blank" >github.com</a> 
OpenAI Platform: <a href="https://platform.openai.com/?featured_on=talkpython" target="_blank" >platform.openai.com</a> 
Hugging Face: <a href="https://huggingface.co/?featured_on=talkpython" target="_blank" >huggingface.co</a> 
Llama: <a href="https://llama.com/?featured_on=talkpython" target="_blank" >llama.com</a> 
Granola: <a href="https://www.granola.ai/?featured_on=talkpython" target="_blank" >www.granola.ai</a> 
HIPAA - HHS: <a href="https://www.hhs.gov/hipaa?featured_on=talkpython" target="_blank" >www.hhs.gov</a> 
CodeRabbit: <a href="https://www.coderabbit.ai/?featured_on=talkpython" target="_blank" >www.coderabbit.ai</a> 
Cursor Origin: <a href="https://cursor.com/origin?featured_on=talkpython" target="_blank" >cursor.com</a> 
GitHub Status: <a href="https://www.githubstatus.com/?featured_on=talkpython" target="_blank" >www.githubstatus.com</a> 
Midjourney Medical: <a href="https://www.midjourney.com/medical?featured_on=talkpython" target="_blank" >www.midjourney.com</a> 
Neko Health: <a href="https://www.nekohealth.com/?featured_on=talkpython" target="_blank" >www.nekohealth.com</a> 
CERN: <a href="https://home.cern/?featured_on=talkpython" target="_blank" >home.cern</a> 
ATLAS Experiment: <a href="https://atlas.cern/?featured_on=talkpython" target="_blank" >atlas.cern</a> 
 
Watch this episode on YouTube: <a href="https://www.youtube.com/watch?v=pp2v9paEoq4" target="_blank" >youtube.com</a> 
Episode #554 deep-dive: <a href="https://talkpython.fm/episodes/show/554/trustworthy-ai-in-healthcare-and-longevity#takeaways-anchor" target="_blank" >talkpython.fm/554</a> 
Episode transcripts: <a href="https://talkpython.fm/episodes/transcript/554/trustworthy-ai-in-healthcare-and-longevity" target="_blank" >talkpython.fm</a> 
 
Theme Song: Developer Rap 
🥁 Served in a Flask 🎸: <a href="https://talkpython.fm/flasksong" target="_blank" >talkpython.fm/flasksong</a> 
 
---== Don't be a stranger ==--- 
YouTube: <a href="https://talkpython.fm/youtube" target="_blank" > youtube.com/@talkpython</a> 
 
Bluesky: <a href="https://bsky.app/profile/talkpython.fm" target="_blank" >@talkpython.fm</a> 
Mastodon: <a href="https://fosstodon.org/web/@talkpython" target="_blank" > @talkpython@fosstodon.org</a> 
X.com: <a href="https://x.com/talkpython" target="_blank" > @talkpython</a> 
 
Michael on Bluesky: <a href="https://bsky.app/profile/mkennedy.codes?featured_on=talkpython" target="_blank" >@mkennedy.codes</a> 
Michael on Mastodon: <a href="https://fosstodon.org/web/@mkennedy" target="_blank" > @mkennedy@fosstodon.org</a> 
Michael on X.com: <a href="https://x.com/mkennedy?featured_on=talkpython" target="_blank" > @mkennedy</a> </div>

Podurama

Home

Trending

Personal

Your Podcasts

New Episodes

My Files

Favourite Episodes

Tags (Folders)

Recently Played

Bookmarks

Followed Playlists

#554: Trustworthy AI in Healthcare and Longevity

Talk Python To Me

AI Chapters

AI Insights

Reviews