Post

You can now run Kimi K2.7 Code locally! 🌘 We shrank the 1T model to 325GB (-48%) via Dynamic 2-bit where important layers are upcasted. Run at >40 tok/s on 330GB RAM/VRAM setups. Run full precision on 610 GB. Guide: unsloth.ai/docs/models/... GGUF: huggingface.co/unsloth/Kimi...

Rasmus Schultz

@mindplay.dk

I wanted to jokingly post a screenshot of me adding 660 GB RAM to my shopping cart, but I literally couldn't find a shop that would even let me add them to the cart 😂

15/6/26, 8:32 pm0 reposts11 likes

No replies yet.