Additionally we have open-sourced the world’s best tokenizer, toks, which is 100% accurate and 13-153x faster than hf_tokenizers github.com/actual-compu...
We've developed a new inference engine, called 'e'. It's the closest thing to alien technology which we have, and pushes 10,500 tok/s aggregate on a single DGX Station with the new @NVIDIAAI Nemotron 3.5 Super VL model. actual.inc/company/blog...
0 reposts33 likes