Post
Google did find a way to reduce memory usage by 6x. But the only way I see LLMs being affordable is local models that run on your own device.
0 reposts2 likes
Google did find a way to reduce memory usage by 6x. But the only way I see LLMs being affordable is local models that run on your own device.
0 reposts2 likes