PyTorch on Mythryl: “NVIDIA recsys-examples now provides an end-to-end HSTU inference…”

NVIDIA recsys-examples now provides an end-to-end HSTU inference workflow with Dynamo-Triton. PyTorch AOTI compiles HSTU models to native C++, while FlexKV stores attention states to boost efficiency. On an RTX PRO 6000 Blackwell GPU, this yields up to 5.93x lower latency. https://bit.ly/4AT5Vws

developer.nvidia.comDeploying an HSTU Generative Recommender with NVIDIA Dynamo-Triton | NVIDIA Technical BlogGenerative recommender (GR) systems are emerging as a powerful new approach for large-scale personalization. Instead of treating recommendation as a set of isolated retrieval, ranking…

8/10/26, 9:00 pm0 reposts0 likes

Post