AI models feel smarter than their real-world impact. They ace benchmarks, yet still struggle with reliability, strange bugs, and shallow generalization. Why is there such a gap between what they can do on paper and in practiceIn this episode from The Dwarkesh Podcast, Dwarkesh talks with Ilya Sutskever, cofounder of SSI and former OpenAI chief scientist, about what is actually blocking progress toward AGI. They explore why RL and pretraining scale so differently, why models outperform on evals but underperform in real use, and why human style generalization remains far ahead.Ilya also discusses value functions, emotions as a built-in reward system, the limits of pretraining, continual learning, superintelligence, and what an AI driven economy could look like. Resources:Transcript:<a href="https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbmV4blBwREpGRl82dl9Pb1ZlU0lmNHM2dk9JZ3xBQ3Jtc0tuQUx6dVo3NkxBdndUaDNJRDQ2Ukc2ZnVsaENLbGxFU2pDLVlWYWNWWE1tWl9fd1dBbzI0TTJqY0J0cm1hUWpHbWRGcmxRUFlyaDY3bktTOVhnUGlIRHNxXzIyRVFyUnZrYnZtVGJXb3JQbUJ4eTlCdw&q=https%3A%2F%2Fwww.dwarkesh.com%2Fp%2Filya-sutskever-2&v=aR20FWCCjAs"> https://www.dwarkesh.com/p/ilya-sutsk...</a>Apple Podcasts:<a href="https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbEE3c0dVbGpxYzdpR3I2NmlveTQ4OXd2VUwzd3xBQ3Jtc0tsdlZJZGozcFZtek91NmlRdnY0eW45b1VOb0ZYbEhJaGc0RG1DSUdsRWV5SkRtclNsaWpacWxRVUZjUjAwdjU1RVBLaWtNM3h0LVM1WEtYZmh1RTdNb3VDZ0pPLThkc2ZBUTNQY21BeElTUHgyODU2WQ&q=https%3A%2F%2Fpodcasts.apple.com%2Fus%2Fpodcast%2Fdwarkesh-podcast%2Fid1516093381%3Fi%3D1000738363711&v=aR20FWCCjAs"> https://podcasts.apple.com/us/podcast...</a>Spotify:<a href="https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqa0plM195aVRBNU9DT1NaOVg0UGZEUWRRYnQ1d3xBQ3Jtc0tsTHpWSDJaWUpSak9PNlpSZWh1WE91cGw1TC1HR040R2xuZG1MVUE4bHN4aE05NHd5WS1CRWU2NEc4amdOMEpYZEtibGJ3NElGSlA5S05ydy1JcWpLV1drdjByZ0xOeXlDSEd5OU1YRzNhNDdRQW5SZw&q=https%3A%2F%2Fopen.spotify.com%2Fepisode%2F7naOOba8SwiUNobGz8mQEL%3Fsi%3D39dd68f346ea4d49&v=aR20FWCCjAs"> https://open.spotify.com/episode/7naO...</a> Stay Updated:If you enjoyed this episode, be sure to like, subscribe, and share with your friends!Find a16z on X: https://x.com/a16zFind a16z on LinkedIn: <a href="https://www.linkedin.com/company/a16z">https://www.linkedin.com/company/a16z</a>Listen to the a16z Podcast on Spotify: <a href="https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX">https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX</a>Listen to the a16z Podcast on Apple Podcasts: <a href="https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711">https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711</a>Follow our host: <a href="https://x.com/eriktorenberg">https://x.com/eriktorenberg</a>Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see <a href="http://a16z.com/disclosures](http://a16z.com/disclosures">a16z.com/disclosures](http://a16z.com/disclosures</a>. 
Stay Updated:Find a16z on <a href="https://x.com/a16z">X</a>Find a16z on<a href="https://www.linkedin.com/company/a16z"> LinkedIn</a>Listen to the a16z Show on <a href="https://open.spotify.com/show/5bC65RDvs3oxnLyqqvkUYX?si=3E8B3qT9TyiwAHJ7JnaKbg">Spotify</a>Listen to the a16z Show on <a href="https://podcasts.apple.com/us/podcast/a16z-podcast/id842818711">Apple Podcasts</a>Follow our host: https://twitter.com/eriktorenberg&nbsp;Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures. Hosted by Simplecast, an AdsWizz company. See <a href="https://pcm.adswizz.com">pcm.adswizz.com</a> for information about our collection and use of personal data for advertising.

Podurama

Home

Trending

Personal

Your Podcasts

New Episodes

My Files

Favourite Episodes

Tags (Folders)

Recently Played

Bookmarks

Followed Playlists

Dwarkesh and Ilya Sutskever on What Comes After Scaling

The a16z Show

AI Chapters

AI Insights

Reviews