Bret and Nirmal are joined by friend of the show, Matt Williams, to learn how to run your own local ChatGPT clone and GitHub Copilot clone with Ollama and Docker's "GenAI Stack," to build apps on top of open source LLMs.We've designed this conversation for tech people like myself, who are no strangers to using LLMs in web products like chat GPT, but are curious about running open source generative AI models locally and how they might set up their Docker environment to develop things on top of these open source LLMs.Matt Williams is walking us through all the parts of this solution, and with detailed explanations, shows us how Ollama can make it easier on Mac, Windows, and Linux to set up LLM stacks.Be sure to check out the <a href="https://www.youtube.com/live/Zelrnjdh1Bc?si=a6iBSwtMmQxdwRjL&t=395">live recording</a> of the complete show from April 18, 2024 on YouTube (Ep. 262).  ★Topics★Creators & Guests<ul>
 <li><a href="https://podcast.bretfisher.com/people/cristi-cotovan">Cristi Cotovan</a> - Editor</li>
 <li><a href="https://podcast.bretfisher.com/people/beth-fisher">Beth Fisher</a> - Producer</li>
 <li><a href="https://podcast.bretfisher.com/people/bret-fisher">Bret Fisher</a> - Host</li>
 <li><a href="https://podcast.bretfisher.com/people/matt-williams">Matt Williams</a> - Host</li>
 <li><a href="https://podcast.bretfisher.com/people/nirmal-mehta">Nirmal Mehta</a> - Host</li>
</ul>
<ul><li>(00:00) - Intro</li>
<li>(01:32) - Understanding LLMs and Ollama</li>
<li>(03:16) - Ollama's Elevator Pitch</li>
<li>(08:40) - Installing and Extending Ollama</li>
<li>(17:17) - HuggingFace and Other Libraries</li>
<li>(19:24) - Which Model Should You Use?</li>
<li>(26:28) - Ollama and Its Applications</li>
<li>(28:57) - Retrieval Augmented Generation (RAG)</li>
<li>(36:44) - Deploying Models and API Endpoints</li>
<li>(40:38) - DockerCon Keynote and LLM Demo</li>
<li>(47:44) - Getting Started with Ollama</li>
</ul>
You can also support my free material by subscribing to my <a href="https://www.youtube.com/@BretFisher">YouTube</a> channel and my weekly newsletter at <a href="https://bret.news/">bret.news</a>!Grab the best coupons for my <a href="https://www.bretfisher.com/courses">Docker and Kubernetes courses</a>.Join my cloud native DevOps community <a href="https://devops.fan/">on Discord</a>.Grab some merch at <a href="https://bretfisher.myspreadshop.com/">Bret's Loot Box</a>Homepage <a href="https://bretfisher.com/">bretfisher.com</a>

Podurama

Home

Trending

Personal

Your Podcasts

New Episodes

My Files

Favourite Episodes

Tags (Folders)

Recently Played

Bookmarks

Followed Playlists

Local GenAI LLMs with Ollama and Docker

DevOps and Docker Talk: Cloud Native Interviews and Tooling

AI Chapters

AI Insights

Reviews