“On the Dwarkesh/Chollet Podcast, and the cruxes of scaling to AGI” by JWS

Overview Recently Dwarkesh Patel released an interview with François Chollet (hereafter Dwarkesh and François). I thought this was one of Dwarkesh's best recent podcasts, and one of the best discussions that the AI Community has had recently. Instead of subtweeting those with opposing opinions or vagueposting, we actually got two people with disagreements on the key issue of scaling and AGI having a good faith and productive discussion.[1] I want to explicitly give Dwarkesh a shout-out for having such a productive discussion (even if I disagree with him on the object level) and having someone on who challenges his beliefs and preconceptions. Often when I think of different AI factions getting angry at each other, and the quality of AI risk discourse plummeting, I'm reminded of Scott's phrase "I reject the argument that Purely Logical Debate has been tried and found wanting. Like GK Chesterton, I think it has [...] ---Outline:(00:06) Overview(02:20) The Podcast(02:42) Introducing the ARC Challenge(06:09) Should we expect LLMs to saturate it?(09:32) Has Jack Cole shown LLMs can solve ARC?(11:32) Is there a difference between Skill and Intelligence?(15:31) Are LLMs Just Memorising?(21:49) Are the missing pieces to AGI difficult or hard to solve?(23:49) What would it take for François to change his mind?(24:33) Some Odds and Ends(25:43) TakeawaysThe original text contained 25 footnotes which were omitted from this narration. --- First published: June 15th, 2024 Source: https://forum.effectivealtruism.org/posts/RbCnvWyoiDFQccccj/on-the-dwarkesh-chollet-podcast-and-the-cruxes-of-scaling-to --- Narrated by TYPE III AUDIO.