Post

datacenter inference is and will probably always be less environmentally destructive than local inference btw. the environmentalist option is not 'local AI'.

hm, is this to do with e-waste concerns?

not just ewaste but energy sourcing + distribution is worse to residential lines, consumer batteries are certainly worse, and work cannot be pooled for efficiency gains (e.g. your framework desktop has a floor in wattage even when you're not using it that is basically wasted)