Post

Run any model locally with React Native AI and AI SDK ⚡️

What is going on here? - MLC is an optimized runtime for running different models on iOS, Android, and desktop GPUs - We download the model weights onto the device - Finally, we load it into the engine and set up everything needed for inference

17/9/25, 2:15 pm0 reposts0 likes

Mike

@grabbou.com

17 Sept 2025

Unlike the Apple provider, the MLC provider doesn’t rely on system-wide models. It downloads weights for each model you use, which can take time.

Mike

@grabbou.com

17 Sept 2025

It's an interesting alternative: you can mix both providers, e.g. run Apple on-device first while your remote model downloads in the background. x.com/grabbou/sta...

Mike

@grabbou.com

17 Sept 2025

The MLC provider is part of a broader suite of our tools for running AI on mobile devices. Check them all out here and star the repo! 🔗 github.com/callstackin...

github.comGitHub - callstackincubator/ai: On-device LLM execution in React Native with Vercel AI SDK compatibilityOn-device LLM execution in React Native with Vercel AI SDK compatibility - callstackincubator/ai