Baseten CEO Tuhin Srivastava on Custom Models, and Building the Inference Cloud
Summary
Baseten CEO and co-founder Tuhin Srivastava sits down with Sarah Guo and Elad Gil to discuss the rapid growth of AI inference demand, Baseten’s 30x growth, and why inference is becoming the strategic
Transcript Excerpt
Hi listeners, today Aladdin and I are here with Tuhin Stuba, the founder and CEO of B 10, the AI inference cloud. We're here to talk about capacity constraints for AI compute, why inference is the last market, how the workload is changing, the open-source and perhaps multi-chip future, and what 30x scale in a year looks like. Tuhan, welcome back. >> Hi. Great to see it. Thanks for having me. >> All right. You are in one of the uh craziest markets, AI inference. Uh uh it's very important. There's a lot going on. You guys have grown 30x over the last year. And I think I can say you're expecting to do more than a billion dollars in revenue this year. >> Mhm. >> What's going on? Tell us about scale. >> Yeah. No, it's been it's been nuts. I I think what's happened over the last honestly at 24 m…