Helion, a PyTorch-native kernel DSL, powers a vLLM linear backend with per-shape autotuning. On Hopper, tuning plus hybrid dispatch beat vLLM’s default CUTLASS and DeepGEMM backends. https://pytorch.org/blog/building-a-high-performance-and-portable-vllm-linear-backend-with-helion/
0 reposts1 like