<a href="https://podcast.clearerthinking.org/episode/194/#transcript">Read the full transcript here.</a> <div class="notes-inner"> What does it really mean to align an AI system with human values? What would a powerful AI need to do in order to do "what we want"? How does being an assistant differ from being an agent? Could inter-AI debate work as an alignment strategy, or would it just result in arguments that manipulate human cognitive and emotional biases? How can we make sure that all human values are learned by AIs, not just the values of humans in WEIRD societies? Are our current state-of-the-art LLMs politically left-leaning? How can alignment strategies take into account the fact that our individual and collective values occasionally change over time?Geoffrey Irving is an AI safety researcher at DeepMind. Before that, he led the Reflection Team at OpenAI, was involved in neural network theorem proving at Google Brain, cofounded Eddy Systems to autocorrect code as you type, and worked on computational physics and geometry at Otherlab, D. E. Shaw Research, Pixar, and Weta Digital. He has screen credits on Ratatouille, WALL•E, Up, and Tintin. Learn more about him at his website, <a href="https://naml.us/">naml.us</a>.Further reading:<ul><li><a href="https://gandalf.lakera.ai/">Gandalf: An Educational Game Demonstrating Security Vulnerabilities in Large Language Models</a></li><li><a href="https://openai.com/research/debate">"AI safety via debate"</a></li><li><a href="https://www.anthropic.com/index/claudes-constitution">"Claude's Constitution"</a></li></ul> </div><div>[<a href="https://podcast.clearerthinking.org/episode/194/geoffrey-irving-how-can-ais-know-what-we-want-if-we-don-t-even-know">Read more</a>]</div>

Podurama

Home

Trending

Personal

Your Podcasts

New Episodes

My Files

Favourite Episodes

Tags (Folders)

Recently Played

Bookmarks

Followed Playlists

How can AIs know what we want if we don't even know? (with Geoffrey Irving)

Clearer Thinking with Spencer Greenberg