Sami Badawi on Mythryl: “Switched to llama.cpp and OpenCode for self hosted coding LLMs. On a…”

Switched to llama.cpp and OpenCode for self hosted coding LLMs. On a 32 GB RAM laptop I get decent speed and a 100k context window. Models that fit here are only good for pair programming, so speed is important. llama.app

llama.appllama.app - Official home for llama.cppOfficial website for the llama.cpp project

19/8/26, 4:37 am0 reposts0 likes

Post