Our guest in this episode is Nate Soares, Executive Director of the Machine Intelligence Research Institute, or MIRI. MIRI was founded in 2000 as the Singularity Institute for Artificial Intelligence by Eliezer Yudkowsky, with support from a couple of internet entrepreneurs. Among other things, it ran a series of conferences called the Singularity Summit. In 2012, Peter Diamandis and Ray Kurzweil, acquired the Singularity Summit, including the Singularity brand, and the Institute was renamed as MIRI. Nate joined MIRI in 2014 after working as a software engineer at Google, and since then he’s been a key figure in the AI safety community. In a blogpost at the time he joined MIRI he observed “I turn my skills towards saving the universe, because apparently nobody ever got around to teaching me modesty.” MIRI has long had a fairly pessimistic stance on whether AI alignment is possible. In this episode, we’ll explore what drives that view—and whether there is any room for hope. Selected follow-ups:<ul><li><a href='https://intelligence.org/team/nate-soares/'>Nate Soares</a> - MIRI</li><li><a href='https://intelligence.org/2025/05/15/yudkowsky-and-soares-announce-major-new-book-if-anyone-builds-it-everyone-dies/'>Yudkowsky and Soares Announce Major New Book: “If Anyone Builds It, Everyone Dies”</a> - MIRI</li><li><a href='https://arbital.com/p/bayes_rule/?l=1zq'>The Bayesian model of probabilistic reasoning</a></li><li><a href='https://www.reddit.com/r/OpenAI/comments/1ffwbp5/wakeup_moment_during_safety_testing_o1_broke_out/'>During safety testing, o1 broke out of its VM</a> - Reddit</li><li><a href='https://physicsworld.com/a/leo-szilard-the-physicist-who-envisaged-nuclear-weapons-but-later-opposed-their-use/'>Leo Szilard</a> - Physics World</li><li><a href='https://www.youtube.com/watch?v=8gPSGrpIlkc'>David Bowie - Five Years</a> - Old Grey Whistle Test</li><li><a href='https://www.computer.org/publications/tech-news/trends/amaras-law-and-tech-future'>Amara's Law</a> - IEEE</li><li><a href='https://onlinelibrary.wiley.com/doi/full/10.1002/ntls.20230023'>Robert Oppenheimer calculation of p(doom)</a></li><li><a href='https://controlai.news/p/ais-are-improving-ais'>JD Vance commenting on AI-2027</a></li><li><a href='https://www.lesswrong.com/posts/aPeJE8bSo6rAFoLqg/solidgoldmagikarp-plus-prompt-generation'>SolidGoldMagikarp</a> - LessWrong</li><li><a href='https://www.asml.com/'>ASML</a></li><li><a href='https://en.wikipedia.org/wiki/Chicago_Pile-1'>Chicago Pile-1</a> - Wikipedia</li><li><a href='https://en.wikipedia.org/wiki/Castle_Bravo'>Castle Bravo</a> - Wikipedia</li></ul> Music: Spike Protein, by Koi Discovery, available under CC0 1.0 Public Domain Declaration<a href='https://www.acxiom.com/podcasts/' target='_blank'>Real Talk About Marketing</a>An Acxiom podcast where we discuss marketing made better, bringing you real...Listen on: <a href='https://podcasts.apple.com/podcast/id1463601023' target='_blank'>Apple Podcasts</a> &nbsp; <a href='https://open.spotify.com/show/1rqiMbNFn3kAabnYC0K70a' target='_blank'>Spotify</a> <a href='https://www.youtube.com/@InfoTechRG' target='_blank'>Digital Disruption with Geoff Nielson</a> Discover how technology is reshaping our lives and livelihoods.Listen on: <a href='https://podcasts.apple.com/podcast/id1798209377' target='_blank'>Apple Podcasts</a> &nbsp; <a href='https://open.spotify.com/show/7L9LI7y1rcLVeNEbuUsgCq?si=30O1lE3LSpO8erTD5ov7Xg' target='_blank'>Spotify</a>

Podurama

Home

Trending

Personal

Your Podcasts

New Episodes

My Files

Favourite Episodes

Tags (Folders)

Recently Played

Bookmarks

Followed Playlists

The AI disconnect: understanding vs motivation, with Nate Soares

London Futurists

AI Chapters

AI Insights

Reviews