#Kronk v1.32.0 published Brings adaptive draft-count tuning for MTP speculative decoding, an upgrade to llama.cpp (yzma v1.25.0), new codegen-benchmark tooling, and fixes to GLM tool parsing and embedded MTP compatibility detection. github.com/ardanlabs/kr...
github.comReleases · ardanlabs/kronkYour personal engine for running open source models locally. Use Go for hardware accelerated local inference with llama.cpp and whisper.cpp directly integrated into your Go applications. Kronk prov...
0 reposts1 like