My talk with Dylan at AI Engineer World’s Fair SF is now live! “Optimizing Open Models for Production” covered: - KV caching - Cache-aware routing - Speculative decoding - Disaggregated prefill + decoding - Quantization 🎥 Talk: www.youtube.com/watch?v=TRe1... 📊 Slides: sujee.dev/events/2026-...
youtube.comWhat Makes Open Models Fast in Production — Sujee Maniyam, NebiusYouTube video by AI Engineer
0 reposts1 like