Post

Gonna try local LLM on my old hardware - 5950x, 1080Ti (12GB), 32GB RAM. I wonder if there's anything that could replace any "haiku" usage for claude, with at least 10t/s.

Michal

@arathunku.com

I'm getting 13t/s with www.liquid.ai/blog/lfm2-5-... !!!

liquid.aiLFM2.5-24B-A2B: Built for Fast On-Device Agents | BlogLFM2.5-24B-A2B: an open-weight 24B reasoning model with 2B active parameters, built for fast, private on-device agents. Beats Qwen3.6-35B-A3B on LiveClaw.

Michal

@arathunku.com

doesn't look worthy even for AI judge for bash calls...

15/10/26, 12:01 pm0 reposts0 likes

No replies yet.