Apertus Mini is now running entirely in your browser 🇨🇭 80+ tps for the 1.5B, 60+ tps for the 4B (on my M3). Fully client-side via Transformers.js + ONNX + WebGPU.
2 reposts5 likes
Apertus Mini is now running entirely in your browser 🇨🇭 80+ tps for the 1.5B, 60+ tps for the 4B (on my M3). Fully client-side via Transformers.js + ONNX + WebGPU.
2 reposts5 likes
Apertus isn't just an LLM. it's the Swiss AI Initiative: @epfl-ai-center.bsky.social , @ethz.ch and @cscsch.bsky.social building open weights, open data, open science. And truly open should run anywhere. Including on your device. So as a Swiss dev, I had to bring it to the browser.
Huge thanks to Imanol Schlag, Oleg, @mjaggi.bsky.social, Andrei and the whole Apertus team 🙏. I'm excited to be part of bringing it to the web 🤗