<p>LLMs at Scale: Infrastructure That Keeps AI Safe, Smart & Affordable // MLOps Podcast #341 with Marco Palladino, Kong&#39;s Co-Founder and CTO.Join the Community: <a href="https://go.mlops.community/YTJoinIn" target="_blank" rel="noopener noreferer">https://go.mlops.community/YTJoinIn</a>Get the newsletter: <a href="https://go.mlops.community/YTNewsletter" target="_blank" rel="noopener noreferer">https://go.mlops.community/YTNewsletter</a>// AbstractWhile conversations around AI regulations continue to evolve, the responsibility for AI continues to be with developers. In this episode, Marco Palladino, CTO and co-founder of Kong Inc., explores what it means to build and scale AI responsibly when the rulebook is still being written. He explains that infrastructure should be the frontline defense for enforcing governance, security, and reliability in AI deployments.Marco shares how Kong’s technologies, including AI Gateway and AI Manager, help organizations rein in shadow AI, reduce LLM hallucinations, improve observability, and act as the foundation for agentic workflows.// BioMarco Palladino is an inventor, software developer, and internet entrepreneur. As the CTO and co-founder of Kong, he is Kong’s co-author, responsible for the design and delivery of the company’s products, while also providing technical thought leadership around APIs and microservices within both Kong and the external software community. Prior to Kong, Marco co-founded Mashape in 2010, which became the largest API marketplace and was acquired by RapidAPI in 2017. // Related LinksWebsite: <a href="https://konghq.com/" target="_blank" rel="noopener noreferer">https://konghq.com/</a> <a href="https://www.youtube.com/watch?v=odpPVeQZjHU" target="_blank" rel="noopener noreferer">https://www.youtube.com/watch?v=odpPVeQZjHU</a> <a href="https://www.thestack.technology/the-big-interview-kong-cto-marco-palladino/ " target="_blank" rel="noopener noreferer">https://www.thestack.technology/the-big-interview-kong-cto-marco-palladino/ </a>~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: <a href="https://go.mlops.community/TYExplore" target="_blank" rel="noopener noreferer">https://go.mlops.community/TYExplore</a>Join our Slack community [<a href="https://go.mlops.community/slack" target="_blank" rel="noopener noreferer">https://go.mlops.community/slack</a>]Follow us on X/Twitter [@mlopscommunity](<a href="https://x.com/mlopscommunity" target="_blank" rel="noopener noreferer">https://x.com/mlopscommunity</a>) or [LinkedIn](<a href="https://go.mlops.community/linkedin" target="_blank" rel="noopener noreferer">https://go.mlops.community/linkedin</a>)] Sign up for the next meetup: [<a href="https://go.mlops.community/register" target="_blank" rel="noopener noreferer">https://go.mlops.community/register</a>]MLOps Swag/Merch: [<a href="https://shop.mlops.community/" target="_blank" rel="noopener noreferer">https://shop.mlops.community/</a>]Connect with Demetrios on LinkedIn: <a href="https://www.linkedin.com/in/dpbrinkm/" target="_blank" rel="noopener noreferer">/dpbrinkm</a>Connect with Marco on LinkedIn: <a href="https://www.linkedin.com/in/marcopalladino/ " target="_blank" rel="noopener noreferer">/marcopalladino/</a></p>


Podurama

Home

Trending

Personal

Your Podcasts

New Episodes

My Files

Favourite Episodes

Tags (Folders)

Recently Played

Bookmarks

Followed Playlists

LLMs at Scale: Infrastructure That Keeps AI Safe, Smart & Affordable // Marco Palladino// # 341

MLOps.community

AI Chapters

AI Insights

Reviews