Today Razib talks to Nate Soares the President of the Machine Intelligence Research Institute (MIRI). He joined MIRI in 2014 and has since authored many of its core technical agendas, including foundational documents like Agent Foundations for Aligning Superintelligence with Human Interests. Prior to his work in AI research, Soares worked as a software engineer at Google. He holds a B.S. in computer science and economics from George Washington University. On this episode they discuss his new book, <a href= "https://www.amazon.com/Anyone-Builds-Everyone-Dies-Superhuman/dp/0316595640/ref=sr_1_1?crid=3JS4Q4AVMM1EJ&dib=eyJ2IjoiMSJ9.H6c1HINBBjtk9yZsPp3r0A.NjZHt_xadKFAReSrK5j6DRwV_rM66YVCoA3_4w-AuCQ&dib_tag=se&keywords=If+Anyone+Builds+It%2C+Everyone+Dies%3A+Why+Superhuman+AI+Would+Kill+Us+All%2C&qid=1760024068&sprefix=if+anyone+builds+it%2C+everyone+dies+why+superhuman+ai+would+kill+us+all%2C%2Caps%2C189&sr=8-1" rel="">If Anyone Builds It, Everyone Dies: Why Superhuman AI Would Kill Us All</a>, co-authored with Eliezer Yudkowsky. Soares and Yudkowsky make the stark case that the race to build superintelligent AI is a "suicide race" for humanity. Razib and Soares discuss how AI systems are "grown" rather than deliberately engineered, making them fundamentally opaque and uncontrollable. They explore a concrete extinction scenario, explain why even minimally misaligned goals could lead to human annihilation. Soares urges immediate cooperative action to prevent such a worst-case outcome.

Podurama

Home

Trending

Personal

Your Podcasts

New Episodes

My Files

Favourite Episodes

Tags (Folders)

Recently Played

Bookmarks

Followed Playlists

Nate Soares: we are doomed (probably)

Razib Khan's Unsupervised Learning

AI Chapters

AI Insights

Reviews