David Silver and Lasse Espeholt of Ineffable Intelligence: A Superlearner for the Age of Experience
Summary
David Silver left DeepMind to start Ineffable Intelligence because he believes reinforcement learning through experience—not LLM pre-training—is the path to superintelligence. With thousands of researchers already pursuing LLMs, he chose the 'lamppost no one is looking under' for maximum impact.
Key Takeaways
- The core conviction driving Ineffable: superintelligence emerges through systems that learn from experience via reinforcement learning, not through massive human-labeled datasets like LLMs.
- Lesson from LLM success: scale changes everything. Systems trained on massive data can be fine-tuned on small datasets to completely change behavior—what seemed slow becomes fast with sufficient experience.
- Founder decision-making framework: Choose the problem space where thousands of talented researchers aren't already working. The highest impact comes from pursuing the unconventional path others ignore.
- Exit strategy validation: Don't stay in a corner of a larger organization if your vision fundamentally conflicts with that organization's direction. A focused, dedicated lab gives your approach its full representation.
- Knowledge discovery framework: True AI advancement requires systems that discover knowledge collectively—like humans went from 'gray mush' to discovering all of mathematics, science, and language themselves.
Related topics
Transcript Excerpt
collectively, you know, we started with this kind of gray mush in our head. Um, we somehow started out knowing nothing at all and somehow discovered like everything that humans know today was like this process of collective discovery like of of languages and technology and science and mathematics and uh all the rest of it you know everything we learned we we discovered it for ourselves and that's an incredible thing that no one has cracked yet in AI and so to me that is the essence of what it will take to get to super intelligence like a system that can just keep learning and discovering knowledge forever. >> [music] >> I'm thrilled to have Dave Silver and Le Espol with us, two of the co-founders of ineffable Intelligence. Uh, great name by the way. Fun fact, Dave, you were the first perso…
More from Sequoia Capital
- Google's AI Infrastructure Chief, Amin Vahdat, on the Physics & Economics of Frontier AI
- Databricks’ Ali Ghodsi Never Wanted to Be CEO. Now He’s Among the Best
- Rich Sutton: synthetic data is "just a big mistake"
- Parallel’s Parag Agrawal: Building a New Web for AI Agents
- Rich Sutton and Khurram Javed: Why AI Models Stop Learning, and How to Start It Again