"running vllm at scale" is an NP-hard problem
also we we've been working for months to reproduce deepseek quality of inference. it is difficult like $100M budget + right connections + getting the right 10 people in the world to help you difficult if you ever see anyone claiming they can do this, they are lying
0 reposts3 likes