<p>Today on Elixir Wizards, hosts Sundi Myint and Charles Suggs catch up with Sean Moriarity, co-creator of the Nx project and author of Machine Learning in Elixir. Sean reflects on his transition from the military to a civilian job building large language models (LLMs) for software. He explains how the Elixir ML landscape has evolved since the rise of ChatGPT, shifting from building native model implementations toward orchestrating best-in-class tools. </p>

<p>We discuss the pragmatics of adding ML to Elixir apps: when to start with out-of-the-box LLMs vs. rolling your own, how to hook into Python-based libraries, and how to tap Elixir’s distributed computing for scalable workloads. Sean closes with advice for developers embarking on Elixir ML projects, from picking motivating use cases to experimenting with domain-specific languages for AI-driven workflows.</p>

<h3>Key topics discussed in this episode:</h3>

<ul>
<li>The evolution of the Nx (Numerical Elixir) project and what&#39;s new with ML in Elixir</li>
<li>Treating Elixir as an orchestration layer for external ML tools</li>
<li>When to rely on off-the-shelf LLMs vs. custom models</li>
<li>Strategies for integrating Elixir with Python-based ML libraries</li>
<li>Leveraging Elixir’s distributed computing strengths for ML tasks</li>
<li>Starting ML projects with existing data considerations</li>
<li>Synthetic data generation using large language models</li>
<li>Exploring DSLs to streamline AI-powered business logic</li>
<li>Balancing custom frameworks and service-based approaches in production</li>
<li>Pragmatic advice for getting started with ML in Elixir</li>
</ul>

<h3>Links mentioned:</h3>

<p><a href="https://hexdocs.pm/nx/intro-to-nx.html" rel="nofollow">https://hexdocs.pm/nx/intro-to-nx.html</a>
<a href="https://pragprog.com/titles/smelixir/machine-learning-in-elixir/" rel="nofollow">https://pragprog.com/titles/smelixir/machine-learning-in-elixir/</a>
<a href="https://magic.dev/" rel="nofollow">https://magic.dev/</a>
<a href="https://smartlogic.io/podcast/elixir-wizards/s10-e10-sean-moriarity-machine-learning-elixir/" rel="nofollow">https://smartlogic.io/podcast/elixir-wizards/s10-e10-sean-moriarity-machine-learning-elixir/</a>
Pragmatic Bookshelf: <a href="https://pragprog.com/" rel="nofollow">https://pragprog.com/</a> 
ONNX Runtime Bindings for Elixir: <a href="https://github.com/elixir-nx/ortex" rel="nofollow">https://github.com/elixir-nx/ortex</a> 
<a href="https://github.com/elixir-nx/bumblebee" rel="nofollow">https://github.com/elixir-nx/bumblebee</a>
Silero Voice Activity Detector: <a href="https://github.com/snakers4/silero-vad" rel="nofollow">https://github.com/snakers4/silero-vad</a> 
Paulo Valente Graph Splitting Article: <a href="https://dockyard.com/blog/2024/11/06/2024/nx-sharding-update-part-1" rel="nofollow">https://dockyard.com/blog/2024/11/06/2024/nx-sharding-update-part-1</a> 
Thomas Millar&#39;s Twitter <a href="https://x.com/thmsmlr" rel="nofollow">https://x.com/thmsmlr</a> 
<a href="https://github.com/thmsmlr/instructor_ex" rel="nofollow">https://github.com/thmsmlr/instructor_ex</a> 
<a href="https://phoenix.new/" rel="nofollow">https://phoenix.new/</a>
<a href="https://tidewave.ai/" rel="nofollow">https://tidewave.ai/</a>
<a href="https://en.wikipedia.org/wiki/BERT_(language_model)" rel="nofollow">https://en.wikipedia.org/wiki/BERT_(language_model)</a>
Talk: PyTorch: <a href="https://www.youtube.com/watch?v=am895oU6mmY" rel="nofollow">Fast Differentiable Dynamic Graphs in Python</a> by Soumith Chintala
<a href="https://hexdocs.pm/axon/Axon.html" rel="nofollow">https://hexdocs.pm/axon/Axon.html</a>
<a href="https://hexdocs.pm/exla/EXLA.html" rel="nofollow">https://hexdocs.pm/exla/EXLA.html</a>
VLM (Vision Language Models Explained): <a href="https://huggingface.co/blog/vlms" rel="nofollow">https://huggingface.co/blog/vlms</a> 
<a href="https://github.com/ggml-org/llama.cpp" rel="nofollow">https://github.com/ggml-org/llama.cpp</a>
Vector Search in Elixir: <a href="https://github.com/elixir-nx/hnswlib" rel="nofollow">https://github.com/elixir-nx/hnswlib</a> 
<a href="https://www.amplified.ai/" rel="nofollow">https://www.amplified.ai/</a>
Llama 4 <a href="https://mistral.ai/" rel="nofollow">https://mistral.ai/</a>
Mistral Open-Source LLMs: <a href="https://mistral.ai/" rel="nofollow">https://mistral.ai/</a> 
<a href="https://github.com/openai/whisper" rel="nofollow">https://github.com/openai/whisper</a>
Elixir Wizards Season 5: Adopting Elixir <a href="https://smartlogic.io/podcast/elixir-wizards/season-five" rel="nofollow">https://smartlogic.io/podcast/elixir-wizards/season-five</a> 
<a href="https://docs.ray.io/en/latest/ray-overview/index.html" rel="nofollow">https://docs.ray.io/en/latest/ray-overview/index.html</a>
<a href="https://hexdocs.pm/flame/FLAME.html" rel="nofollow">https://hexdocs.pm/flame/FLAME.html</a>
<a href="https://firecracker-microvm.github.io/" rel="nofollow">https://firecracker-microvm.github.io/</a>
<a href="https://fly.io/" rel="nofollow">https://fly.io/</a>
<a href="https://kubernetes.io/" rel="nofollow">https://kubernetes.io/</a>
WireGuard VPNs <a href="https://www.wireguard.com/" rel="nofollow">https://www.wireguard.com/</a> 
<a href="https://hexdocs.pm/phoenixpubsub/Phoenix.PubSub.html" rel="nofollow">https://hexdocs.pm/phoenixpubsub/Phoenix.PubSub.html</a>
<a href="https://www.manning.com/books/deep-learning-with-python" rel="nofollow">https://www.manning.com/books/deep-learning-with-python</a>
Code BEAM 2025 Keynote: Designing LLM Native Systems - Sean Moriarity
Ash Framework <a href="https://ash-hq.org/" rel="nofollow">https://ash-hq.org/</a> 
Sean’s Twitter: <a href="https://x.com/seanmoriarity" rel="nofollow">https://x.com/seanmoriarity</a> 
Sean’s Personal Blog: <a href="https://seanmoriarity.com/" rel="nofollow">https://seanmoriarity.com/</a>
Erlang Ecosystems Foundation Slack: <a href="https://erlef.org/slack-invite/erlef" rel="nofollow">https://erlef.org/slack-invite/erlef</a> 
Elixir Forum <a href="https://elixirforum.com/" rel="nofollow">https://elixirforum.com/</a>
Sean’s LinkedIn: <a href="https://www.linkedin.com/in/sean-m-ba231a149/" rel="nofollow">https://www.linkedin.com/in/sean-m-ba231a149/</a></p><p>Special Guest: Sean Moriarity.</p>

Podurama

Home

Trending

Personal

Your Podcasts

New Episodes

My Files

Favourite Episodes

Tags (Folders)

Recently Played

Bookmarks

Followed Playlists

Nx and Machine Learning in Elixir with Sean Moriarity

Elixir Wizards

AI Chapters

AI Insights

Reviews