Elena Burger and Matt Bornstein are joined by Simon Mo, co-founder and CEO of Inferact, the open-source inference engine powering many of today's most advanced AI applications. Together, they explore how open-source AI evolved from a research project into critical infrastructure, why inference has become one of the most important layers of the AI stack, and what it takes to bring frontier intelligence to developers around the world.
The conversation covers vLLM's origins, the rise of open-weight models, why companies increasingly want control over their AI infrastructure, and how open-source inference enables the next generation of AI applications. They also discuss model licensing, the economics of open-weight AI, Kimi K3, distillation, AI infrastructure, and why Simon believes the gap between open and closed models is rapidly disappearing.
 
Resources:
Follow Simon Mo on X:<a href="https://x.com/simon_mo_" rel="noopener noreferrer"> https://x.com/simon_mo_</a>
Follow Matt Bornstein on X:<a href="https://x.com/bornstein" rel="noopener noreferrer"> </a><a href="https://x.com/BornsteinMatt" rel="noopener noreferrer">https://x.com/BornsteinMatt</a>
Follow Elena Burger on X:<a href="https://x.com/VirtualElena" rel="noopener noreferrer"> https://x.com/VirtualElena</a>
Follow Inferact:<a href="https://infractsystems.com/" rel="noopener noreferrer"> </a><a href="https://x.com/inferact" rel="noopener noreferrer">https://x.com/inferact</a>
Stay Updated:Find a16z on YouTube: <a href="https://www.youtube.com/@a16z">YouTube</a>Find a16z on <a href="https://x.com/a16z">X</a>Find a16z on<a href="https://www.linkedin.com/company/a16z"> LinkedIn</a>Listen to the a16z Show on <a href="https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX?si=3E8B3qT9TyiwAHJ7JnaKbg">Spotify</a>Listen to the a16z Show on <a href="https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711">Apple Podcasts</a>Follow our host: <a href="https://twitter.com/eriktorenberg">https://twitter.com/eriktorenberg</a>&nbsp;Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures. Hosted by Simplecast, an AdsWizz company. See <a href="https://pcm.adswizz.com">pcm.adswizz.com</a> for information about our collection and use of personal data for advertising.

Podurama

Home

Trending

Personal

Your Podcasts

New Episodes

My Files

Favourite Episodes

Tags (Folders)

Recently Played

Bookmarks

Followed Playlists

How Open-Source AI Became Critical Infrastructure

The a16z Show

AI Chapters

AI Insights

Reviews