In a very unusual Tidbit episode of Programming By Stealth, Allison interviews NosillaCastaway and Programming By Stealth student Steve Mattan about how he's running Large Language Models locally on his Mac. He pulls this off using a series of open source tools, starting with Ollama for the models from the command line, and then Enchanted to give him a nice GUI. He explains how he's integrated the local LLM into VSCode for his coding, and how he uses Keyboard Maestro to launch all of this at once.

You can find the outline and links to how Steve's doing this at <a href="https://pbs.bartificer.net/tidbit10">pbs.bartificer.net</a>.

Read an unedited, auto-generated transcript with chapter marks: <a href="https://podfeet.com/transcripts/PBS_2024_12_21.html">PBS_2024_12_07</a>

Join our Slack at <a href="https://podfeet.com/slack">podfeet.com/slack</a> and look for the #pbs channel, and check out our <a href ="https://github.com/pbs-students" target="_blank" rel="noopener">pbs-student GitHub Organization</a>. It's by invitation only but all you have to do is ask Allison!

<hr>
Join the Conversation:
<ul>
<li><a href="mailto:allison@podfeet.com">allison@podfeet.com</a></li>
<li><a href="http://podfeet.com/slack" target="_blank" rel="noopener noreferrer">podfeet.com/slack</a></li>
</ul>
Support the Show:
<ul>
<li><a href="https://www.podfeet.com/patreon" target="_blank" rel="noopener noreferrer">Patreon Donation</a></li>
<li><a href="https://podfeet.com/donate" target="_blank" rel="noopener noreferrer">Apple Pay or Credit Card one-time donation</a></li>
<li><a href="https://podfeet.com/paypal" target="_blank" rel="noopener noreferrer">PayPal one-time donation</a></li>
<li><a href="https://www.zazzle.com/podfeet_podcasts_coffee_mug-168735677754947563" target="%5Fblank" rel="noopener">Podfeet Podcasts Mugs at Zazzle</a></li>
<li><a href="https://cottonbureau.com/products/podfeet-15-year-anniversary-shirt#/4278978/tee-men-standard-tee-vintage-red-tri-blend-s" target="%5Fblank" rel="noopener">Podfeet 15-Year Anniversary Shirts</a></li>
</ul>
Referral Links:

<ul>
<li><a href="https://podfeet.com/parallelstoolbox">Parallels Toolbox - 3 months free for you and me</a></li>
<li><a href="https://podfeet.com/macsparky" target="%5Fblank" rel="noopener">Learn through MacSparky Field Guides - 15% off for you and me</a></li>
<li><a href="https://secure.backblaze.com/r/01zmio" target="%5Fblank" rel="noopener">Backblaze - One free month for me and you</a></li>
<li><a href="https://setapp.sjv.io/c/4835528/343321/5114" target="%5Fblank" rel="noopener">Setapp - One free month for me and you</a></li>
<li><a href="https://share.eufylife.com/v1/shopping/s/g/e-GkwxRA-" target="%5Fblank" rel="noopener">Eufy - $40 for me if you spend $200. Sadly nothing in it for you.</a></li>
<li><a href="https://www.privateinternetaccess.com/pages/buy-a-vpn/1218buyavpn?invite=U2FsdGVkX182XdJGIOFG6t8UZUmK_QY_fyujdZB6ekM%2C0CVvGHU-flt21G9A5Nj-fL1Yet0" target="%5Fblank" rel="noopener">PIA VPN - One month added to Paid Accounts for both of us</a></li>
<li><a href="https://cleanshot.sjv.io/4P249n" target="%5Fblank" rel="noopener">CleanShot X - Earns me $25%, sorry nothing in it for you but my gratitude</a></li>
</ul>

Podurama

Home

Trending

Personal

Your Podcasts

New Episodes

My Files

Favourite Episodes

Tags (Folders)

Recently Played

Bookmarks

Followed Playlists

PBS Tidbit 10 — Run LLMs Locally with Ollama with Steve Mattan

Programming By Stealth

AI Chapters

AI Insights

Reviews