Offline On-Device AI Agents with Gemma & Local Tool Calls (feat. @shivaylamba.bsky.social) How do you run an agentic healthcare workflow without sending private patient data to the cloud? Run local Speech-to-Text + a 12B Gemma model on-device to execute pharmacy tool calls 100% offline.
Post
Explore Shivay Lamba's interactive Edge Inference walkthrough: https://inside-edge-inference.vercel.app/request/?phase=1 Full episode coming soon on CodingCat.dev: https://codingcat.dev/podcasts
0 reposts0 likes
No replies yet.