William (Bill) Kennedy

William (Bill) Kennedy

@goinggo.net

⌯Go ⦁ Walking the line between correctness and comprehension ⦁ bill@ardanlabs.com ⦁ kronkai.com ⦁ wife(aleintech.com) ⦁ GoBridge

2.1K followers183 following462 posts

William (Bill) Kennedy reposted

Replying to @goinggo.net

A model on integrated graphics, playing a full game in real time, while my own chat model crawls at a speed I don't want to name. Nothing leaves the machine. This is how local AI should be demoed, not with a 24GB card.

William (Bill) Kennedy reposted

Austin, just 1 week until the next Cloud Native meetup! 🚀 Join @goinggo.net as he dives into open-source AI inference, model serving, and Kronk in his featured talk “Ultimate AI: Go with your own intelligence.” 📅 Oct 22 | 📍 Station Austin 🔗Register: ocgroups.dev/cncf/group/3...

ocgroups.devUltimate AI: Go with your own intelligence - October 22Cloud Native Austin in CNCF community. Open Community Groups, where Open Source communities thrive.

How cool is this! #Kronk #golang Kronk Jev Game is an endless runner. Play the top half of the screen. A small AI model plays the same map in the bottom half, at the same time. No cloud. No API key. Nothing leaves the machine. The model runs on my laptop's integrated GPU. lnkd.in/p/ehuYbP7J

lnkd.in#golang #localai #opensource | Jonathan VuilleminI raced an AI model in my terminal, and it ran entirely on my laptop. Kronk Jev Game is an endless runner. I play the top half of the screen. A small AI model plays the same map in the bottom half, ...

William (Bill) Kennedy reposted

A great evening with the Go community in San Francisco! 🐹🌉 @goinggo.net took the stage to talk about self-hosted LLMs in Go, exploring what’s possible when AI runs closer to the code, the hardware, and the engineer. Thanks to everyone who joined and GoSF for a great meetup! 🙌

William (Bill) Kennedy reposted

San Francisco, we’re meeting tomorrow! 🦾 Join us at Antithesis for the next GoSF meetup: 🦾 @goinggo.net : Self-Hosted LLMs in Go ☕ Live Cup o’ Go with Shay Nehmad 📍 Oct 7th | 5:30–8 PM PDT & we’re raffling an Ardan Labs training bundle 👀 www.meetup.com/golangsf/eve...

William (Bill) Kennedy reposted

Yesterday, @goinggo.net joined the GolangNYC Meetup in New York City. Great conversations, a room full of developers, and plenty of ideas shared around building with Go. Thanks to everyone who came out and made it a great meetup! 📸 Sharing a few moments from the event below.

v1.32.7 Released Version 1.32.7 brings image generation into the model server with new API endpoints and BUI screens, a new OpenAI-compatible audio translation endpoint, Wan2.2 S2V audio-conditioned video support in the Malina SDK, and llama.cpp upgrades through b11017. github.com/ardanlabs/kr...

github.comReleases · ardanlabs/kronkGo With Your Own Intelligence! Use Go for hardware accelerated local inference with llama.cpp, whisper.cpp, and stable-diffusion.cpp directly integrated into your Go applications. Kronk provides a ...

William (Bill) Kennedy reposted

That’s a wrap on GopherCon LATAM! 🇧🇷 Thank you to everyone who joined us, stopped by, and shared conversations with the Ardan Labs team. A special thank you to the organizers, @goinggo.net , and the Ardan Labs engineers who attended and made the conference a great experience. Until next time! 👋

William (Bill) Kennedy reposted

@goinggo.net is kicking off a workshop: Ultimate AI, at @gophercon.com LATAM today. 🇧🇷 A room full of engineers, Go + AI, and lots of hands-on learning. Here are a few snapshots from the workshop 👇 #GopherConLATAM #golang #ArdanLabs

William (Bill) Kennedy reposted

YouTube short of the week is here!💻 This week revolves around “Discovering Go While Working at Google” from @goinggo.net's podcast episode with featured guest Jonathan Amsterdam! 🤓 🎥: youtube.com/shorts/FZLlb... #ArdanLabsPodcast #Shorts #YouTube #SoftwareEngineering

youtube.comDiscovering Go While Working at GoogleThis clip is from the Ardan Labs Podcast with featured guest Jonathan Amsterdam! You can watch the full episode here: https://youtu.be/CNT_9FaVIHI Other Links: Website:…

In my neverending attempts to make these models behave well enough for real usage, @dlsniper shared these non-thinking settings with me this morning and I have to say the model is usable today. That can change by the hour, but it's usable!

#Kronk v1.32.1 Released Removes the adaptive MTP draft-count algorithm and its runtime reporting. MTP speculative decoding now always runs with the configured fixed `ndraft` value, while classic separate-draft speculation retains its acceptance-EMA adaptive throttling.

#Kronk v1.32.0 published Brings adaptive draft-count tuning for MTP speculative decoding, an upgrade to llama.cpp (yzma v1.25.0), new codegen-benchmark tooling, and fixes to GLM tool parsing and embedded MTP compatibility detection. github.com/ardanlabs/kr...

github.comReleases · ardanlabs/kronkYour personal engine for running open source models locally. Use Go for hardware accelerated local inference with llama.cpp and whisper.cpp directly integrated into your Go applications. Kronk prov...

I wrote a program that uses OpenCode to have different models write a Go based tic-tac-toe game. This take a wee bit of time to run for all models. The Gemma4 and the Qwen3.8 models always do well. I wish the Qwen3.8 ran faster. Tomorrow Qwen3.8 Flash is being released!

Here is the "fun" kronk has to deal with for you. ndraft=3 for MTP works great for Qwen/Gemma but not for Ornith. Ornith works better with ndraft=2. llama.cpp hardcodes 3. Kronk uses an adaptive algorithm that can downgrade from 3 to 2 based on sampling, so Ornith runs faster.

Just downloaded the latest version of the @ornith_ 1.5 35B-A3B model and guess what? The model is running better at ndraft=3 now. Hahaha Always look for new uploads of your favorite models.

This is a simple example of why you need to be looking at diffs when the model/agent is making code changes. This is why vibe coding is going to cause all sorts of problems over time with codebases. There needs to be a human in the loop.

William (Bill) Kennedy reposted

My new article, the Kronk SDK, is live. 3 important components: → prep: messages validated, templated and tokenized into a job → KV cache: restore the prefix, decode only what's new → engine: makes your tokens tick concurrently internals-for-interns.com/posts/kronk-... #golang #AI

internals-for-interns.comThe Kronk SDK | Internals for InternsIn the previous article we took yzma apart and found a very disciplined bridge: purego finds the functions inside libllama.so, libffi makes the calls, and no C compiler is involved anywhere. What you...