Post

aly
@aly.codes

datacenter inference is and will probably always be less environmentally destructive than local inference btw. the environmentalist option is not 'local AI'.

aly@aly.codes

"soon most AI will be local" yeah sure, the way most gaming is candycrush and subway surfers. what is the point here

aly
@aly.codes

not just ewaste but energy sourcing + distribution is worse to residential lines, consumer batteries are certainly worse, and work cannot be pooled for efficiency gains (e.g. your framework desktop has a floor in wattage even when you're not using it that is basically wasted)

0 reposts9 likes