Post

for all talks of local-first AI, given controversies over datacenters, I don't think people are willing to hear that local LLM inference is *probably* less environmentally friendly than cloud inference the majority of the time.

yeah I mean as a fellow local AI user I'm not saying there aren't reasons you'd want it! latency, reliability, privacy, etc. but it's probably not climate friendly. same as running a big media server in my closet lol

0 reposts11 likes

No replies yet.