
The Small Model Infrastructure Nobody Built (So We Did) — Filip Makraduli, Superlinked
Filip Makraduli explains why production embeddings, retrieval, document processing, and agentic workflows need infrastructure designed specifically for small models. Introducing Superlinked Inference Engine (SIE), he describes loading and hot-swapping multiple models on shared GPUs, improving utilization, and combining model support with production…
Filip Makraduli
RAG, context, and search · Infrastructure and deployment · Architecture