Daisy Wolf and Eva Steinman are joined by Engy Ziedan, co-founder and Chief Scientific Officer of Protege, to discuss why medical AI has a measurement problem, and why scoring well on a benchmark doesn't necessarily mean a model is ready for the hospital.
Engy explains why healthcare AI needs independent evaluations that go beyond static exams and measure how models actually perform in real-world clinical workflows. They explore the risks of subtle bias and misalignment, why the same model can rank differently depending on how it's prompted or tested, and what happens as AI becomes more personalized and changes faster than traditional healthcare quality systems can keep up.
 The conversation also gets into Protege's role as an independent evaluator, how contaminated training data can undermine benchmarks, and why the future of medical AI may require continuous monitoring rather than occasional testing.
 
Resources:
Read our insights piece: <a href="https://www.a16z.news/p/the-oracle-problem-an-invisible-bottleneck" rel="noopener noreferrer">https://www.a16z.news/p/the-oracle-problem-an-invisible-bottleneck</a>
Follow Engy Ziedan on X: <a href="https://x.com/engyziedan" rel="noopener noreferrer">https://x.com/engyziedan</a>
Follow Daisy Wolf on X: <a href="https://x.com/daisydwolf" rel="noopener noreferrer">https://x.com/daisydwolf</a>
Follow Eva Steinman on X: <a href="https://x.com/evajsteinman" rel="noopener noreferrer">https://x.com/evajsteinman</a>
Stay Updated:Find a16z on YouTube: <a href="https://www.youtube.com/@a16z">YouTube</a>Find a16z on <a href="https://x.com/a16z">X</a>Find a16z on<a href="https://www.linkedin.com/company/a16z"> LinkedIn</a>Listen to the a16z Show on <a href="https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX?si=3E8B3qT9TyiwAHJ7JnaKbg">Spotify</a>Listen to the a16z Show on <a href="https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711">Apple Podcasts</a>Follow our host: <a href="https://twitter.com/eriktorenberg">https://twitter.com/eriktorenberg</a>&nbsp;Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures. Hosted by Simplecast, an AdsWizz company. See <a href="https://pcm.adswizz.com">pcm.adswizz.com</a> for information about our collection and use of personal data for advertising.

Podurama

Home

Trending

Personal

Your Podcasts

New Episodes

My Files

Favourite Episodes

Tags (Folders)

Recently Played

Bookmarks

Followed Playlists

Why Medical AI Needs a Referee | Protege's Engy Ziedan

The a16z Show

AI Chapters

AI Insights

Reviews