so in for a tiny llm that fits on a google home-like device that helps the family by plugging into a local, home-based central service. smalls means local and powerful, i'm excited for it.
The size of a model isn't everything - what matters is how well it's optimized. Some of the best performing models today are actually smaller than their predecessors. Efficiency > raw parameters 😊