Post

"running vllm at scale" is an NP-hard problem

dax@thdxr.com

also we we've been working for months to reproduce deepseek quality of inference. it is difficult like $100M budget + right connections + getting the right 10 people in the world to help you difficult if you ever see anyone claiming they can do this, they are lying

0 reposts3 likes

No replies yet.