Andrej Karpathy: From Vibe Coding to Agentic Engineering

By Sequoia Capital

Categories: VC, Startup

Summary

December 2024 marked a fundamental shift in AI capabilities—Andrej Karpathy, who coined 'vibe coding,' now says he's never felt more behind as a programmer. The transition from Software 2.0 (learned weights) to Software 3.0 (LLM-as-computer) means programming now means prompting, not coding, forcing teams to completely rethink how they build.

Key Takeaways

  1. December 2024 was the inflection point when LLM outputs stopped requiring corrections. Karpathy stopped remembering the last time he had to edit an AI-generated code chunk, signaling a shift from tool-assisted coding to autonomous agentic workflows.
  2. Software 3.0 paradigm: programming shifts from writing explicit code (1.0) or training neural networks (2.0) to prompting—your context window becomes the lever over the LLM interpreter performing computation in information space.
  3. Practical example: OpenClaw installation replaced complex bash scripts with a simple text prompt you copy-paste to an agent. The agent debugs in-loop and intelligently adapts to different environments, outperforming rigid Software 1.0 scripts.
  4. Agentic coherent workflows became functionally viable in December 2024. Most people experienced AI through ChatGPT-like interfaces in 2024, but missed the fundamental shift: agents with multi-step reasoning and self-correction capabilities.
  5. The 'vibe coding' phenomenon—trusting LLMs to generate entire feature sets without manual verification—only became viable when model quality crossed a reliability threshold where output quality became consistently high enough to require no editing.

Topics

Transcript Excerpt

We're so excited for our very first special guest. He has helped build modern AI, then explain modern AI, and then occasionally rename modern AI. He actually helped co-ound open AAI right inside of this office. Was the one who actually got Autopilot working at Tesla back in the day, and he has a rare gift of making the most complex technical shifts feel both accessible and inevitable. You all know him for having coined the term vibe coding last year, but just in the last few months, he said some...