Modal CEO: Has Open-Source LLM Inference Peaked? | What Happens to the Cost of Compute

By 20VC

Categories: VC, Startup

Summary

Modal's CEO believes there's a $100B+ opportunity in specialized LLM inference despite near-term pullbacks, arguing the long-term compute market is vastly underestimated. He credits his 36-year-old founding age and early coding passion (since age 8) to Modal's $15.75B valuation, rejecting the "founding is pain" narrative in favor of genuine enjoyment.

Key Takeaways

  1. Hundred billion dollar company opportunity exists in specialized inference models with vertical integration, suggesting current market assessments significantly undervalue the sector despite short-term corrections.
  2. Optimal founder age is ~32 rather than early 20s; experience in hiring, firing, and people navigation matters more than raw ambition or confidence, reducing failure risk through seasoned judgment.
  3. Passion-driven founding trumps financial exits; Eric wouldn't sell Modal because he'd immediately start Modal 2, indicating founder retention through mission alignment rather than equity incentives.
  4. Early technical immersion (coding since age 8, programming competitions at 16-17) correlates with later company-building success, suggesting childhood tech fluency compounds into founder advantage.
  5. Reject the "eating glass" founding narrative; sustainable entrepreneurship requires daily enjoyment, not suffering-to-reward mindset, enabling 20-50 year company engagement versus quick exits.

Related topics

Transcript Excerpt

I think there is an opportunity to create a hundred billion dollar company with a lot of specialized models in inference. There's going to be a pullback. I'm okay with that because I think the long-term opportunity is so big. It's like so large. Today, I'm thrilled to welcome Eric, co-founder and CEO of Modal. Now, Modal just hit a billion in AR. They just raised $750 million led by Excel and they're priced at $15.75 billion today. But today we dig into the inference market, what to come, what no one sees that everyone should see, and so much more. >> We've lost new grats going to, you know, some of the labs for like 20 plus million. I mean, these are exceptional people. Exceptional. I don't want to sell this company cuz I would just go and start Modal 2. >> Ready to go. Eric, listen, dude…

More from 20VC