|
In episode 91 of The Gradient Podcast, Daniel Bashir speaks to Arjun Ramani and Zhengdong Wang. Arjun is the global business and economics correspondent at The Economist. Zhengdong is a research engineer at Google DeepMind. Have suggestions for future podcast guests (or other feedback)? Let us know here or reach us at editor@thegradient.pub Subscribe to The Gradient Podcast: Apple Podcasts | Spotify | Pocket Casts | RSSFollow The Gradient on Twitter Outline: * (00:00) Intro * (03:53) Arjun intro * (06:04) Zhengdong intro * (09:50) How Arjun and Zhengdong met in the woods * (11:52) Overarching narratives about technological progress and AI * (14:20) Setting up the claim: Arjun on what “transformative” means * (15:52) What enables transformative economic growth? * (21:19) From GPT-3 to ChatGPT; is there something special about AI? * (24:15) Zhengdong on “real AI” and divisiveness * (27:00) Arjun on the independence of bottlenecks to progress/growth * (29:05) Zhengdong on bottleneck independence * (32:45) More examples on bottlenecks and surplus wealth * (37:06) Technical arguments—what are the hardest problems in AI? * (38:00) Robotics * (40:41) Challenges of deployment in high-stakes settings and data sources / synthetic data, self-driving * (45:13) When synthetic data works * (49:06) Harder tasks, process knowledge * (51:45) Performance art as a critical bottleneck * (53:45) Obligatory Taylor Swift Discourse * (54:45) AI Taylor Swift??? * (54:50) The social arguments * (55:20) Speed of technology diffusion — “diffusion lags” and dynamics of trust with AI * (1:00:55) ChatGPT adoption, where major productivity gains come from * (1:03:50) Timescales of transformation * (1:10:22) Unpredictability in human affairs * (1:14:07) The economic arguments * (1:14:35) Key themes — diffusion lags, different sectors * (1:21:15) More on bottlenecks, AI trust, premiums on human workers * (1:22:30) Automated systems and human interaction * (1:25:45) Campaign text reachouts * (1:30:00) Counterarguments * (1:30:18) Solving intelligence and solving science/innovation * (1:34:07) Strengths and weaknesses of the broad applicability of Arjun and Zhengdong’s argument * (1:35:34) The “proves too much” worry — how could any innovation have ever happened? * (1:37:25) Examples of bringing down barriers to innovation/transformation * (1:43:45) What to do with all of this information? * (1:48:45) Outro Links: * Zhengdong’s homepage and Twitter * Arjun’s homepage and Twitter * Why transformative artificial intelligence is really, really hard to achieve * Other resources and links mentioned: * Allan-Feuer and Sanders: Transformative AGI by 2043 is * On AlphaStar Zero * Hardmaru on AI as applied philosophy * Robotics Transformer 2 * Davis Blalock on synthetic data * Matt Clancy on automating invention and bottlenecks * Michael Webb on 80,000 Hours Podcast * Bob Gordon: The Rise and Fall of American Growth * OpenAI economic impact paper * David Autor: new work paper * Baumol effect paper * Pew research centre poll, public concern on AI * Human premium Economist piece * Callum Williams — London tube and AI/jobs * Culture Series book 1, Iain Banks
Get full access to The Gradient at thegradientpub.substack.com/subscribe |