blog.alaindichiappari.dev/p/what-to-do... interesting read. I hope when value engineering for ram as well as engineering more efficient language models increases this becomes less of an issue and everyone has adequate default models being able to run on their personal computers
blog.alaindichiappari.devWhat to do when tokens run outIf in the '80s we fought to squeeze a program into a few kilobytes, we now have to squeeze the most useful LLM work into the tokens we can afford. You ready?
0 reposts0 likes