Jeff Huber is the CEO of ​<a href="https://www.trychroma.com/" target="_blank" rel="ugc noopener noreferrer">Chroma</a>, working on context engineering and building reliable retrieval infrastructure for AI systems. Context Engineering, Context Rot, & Agentic Search with the CEO of Chroma, Jeff Huber // MLOps Podcast #348.Join the Community: <a href="https://go.mlops.community/YTJoinIn" target="_blank" rel="ugc noopener noreferrer">https://go.mlops.community/YTJoinIn</a>Get the newsletter: <a href="https://go.mlops.community/YTJoinIn" target="_blank" rel="ugc noopener noreferrer">https://go.mlops.community/YTNewsletter</a>// AbstractJeff Huber drops some hard truths about “context rot” — the slow decay of AI memory that’s quietly breaking your favorite models. From retrieval chaos to the hidden limits of context windows, he and Demetrios Brinkmann unpack why most AI systems forget what matters and how Chroma is rethinking the entire retrieval stack. It’s a bold look at whether smarter AI means cleaner context — or just better ways to hide the mess.// BioJeff Huber is the CEO and cofounder of Chroma. Chroma has raised $20M from top investors in Silicon Valley and builds modern search infrastructure for AI.// Related LinksWebsite: <a href="https://www.trychroma.com/" target="_blank" rel="ugc noopener noreferrer">https://www.trychroma.com/</a>~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: <a href="https://go.mlops.community/TYExplore" target="_blank" rel="ugc noopener noreferrer">https://go.mlops.community/TYExplore</a>Join our Slack community [<a href="https://go.mlops.community/slack" target="_blank" rel="ugc noopener noreferrer">https://go.mlops.community/slack</a>]Follow us on X/Twitter [@mlopscommunity](<a href="https://x.com/mlopscommunity" target="_blank" rel="ugc noopener noreferrer">https://x.com/mlopscommunity</a>) or [LinkedIn](<a href="https://go.mlops.community/linkedin" target="_blank" rel="ugc noopener noreferrer">https://go.mlops.community/linkedin</a>)] Sign up for the next meetup: [<a href="https://go.mlops.community/register" target="_blank" rel="ugc noopener noreferrer">https://go.mlops.community/register</a>]MLOps Swag/Merch: [<a href="https://shop.mlops.community/" target="_blank" rel="ugc noopener noreferrer">https://shop.mlops.community/</a>]Connect with Demetrios on LinkedIn: <a href="https://www.linkedin.com/in/dpbrinkm/" target="_blank" rel="ugc noopener noreferrer">/dpbrinkm</a>Connect with Jeff on LinkedIn: <a href="https://www.linkedin.com/in/jeffchuber/" target="_blank" rel="ugc noopener noreferrer">/jeffchuber/</a>Timestamps:[00:00] AI intelligence context clarity[00:37] Context rot explanation[03:02] Benchmarking context windows[05:09] Breaking down search eras[10:50] Agent task memory issues[17:21] Semantic search limitations[22:54] Context hygiene in AI[30:15] Chroma on-device functionality[38:23] Vision for precision systems[43:07] ML model deployment challenges[44:17] Wrap up

Podurama

Home

Trending

Personal

Your Podcasts

New Episodes

My Files

Favourite Episodes

Tags (Folders)

Recently Played

Bookmarks

Followed Playlists

Context Engineering, Context Rot, & Agentic Search with the CEO of Chroma, Jeff Huber

MLOps.community

AI Chapters

AI Insights

Reviews