"llm-d v1.0: State-of-the-art inference, ready for Day 2" llm-d.ai/blog/llm-d-v...
llm-d.aillm-d v1.0: State-of-the-art inference, ready for Day 2 | llm-dllm-d v1.0 graduates the configuration API to v1 and adds multi-tenant quality of service, zero-downtime operations, and agent-aware serving, taking state-of-the-art distributed inference from a stack...
0 reposts0 likes