The Small Model Infrastructure Nobody Built (So We Did) — Filip Makraduli, Superlinked

Name: The Small Model Infrastructure Nobody Built (So We Did) — Filip Makraduli, Superlinked
Uploaded: 2026-05-06T05:36:57.455Z
Duration: 18 min 30 s
Channel: ai.engineer
Description: Most embedding infrastructure assumes you know exactly which model you want ahead of time. This talk starts where that assumption breaks. Filip Makraduli walks through the real profiling mistakes, infrastructure gaps, and production constraints that led to building an embedding inference engine d...

By ai.engineer

Categories: AI, Tools

Transcript Excerpt

Hello everyone. Um, welcome to this talk. I'll be speaking about small model inference and a gap that we've recognized in the market. And what we did about it and why we kind of made this approach. And as you can see this background slide here, um, this is no accident. So, if you can guess what this is, I'll prompt you at the end of the slides, you win a little reward. So, you can catch me at the break afterwards. So, think about this, but also listen to me, so don't think too hard. So, the stor...