Post

aly
@aly.codes

datacenter inference is and will probably always be less environmentally destructive than local inference btw. the environmentalist option is not 'local AI'.

aly@aly.codes

"soon most AI will be local" yeah sure, the way most gaming is candycrush and subway surfers. what is the point here

Juniper
@juniperbevensee.bsky.social

Idk. Our grid in Aotearoa is mostly renewable and when I run local models that's what I pull from. As well no industrial cooling n I'm trying to just get it on mini solar. But it's more about data sovereignty than diseconomies of scale imo.

aly
@aly.codes

I mean sure but you're also not getting nearly the efficiency of just throwing 0.001% of a hyperscalar at a problem for 30 seconds with a much bigger model. yeah it's great it's all renewable but that doesn't change the efficiency equation

0 reposts2 likes

Juniper
@juniperbevensee.bsky.social

Efficiency is an economy of scale question which I think is pretty settled in yr favour but just on the net environmentally destructive question I feel like there's some nuance to be had. Esp in the mesh pooling and co core era post u biquitous home solar.

Ariel M. (she/her)
@byarielm.fyi

this is true 100% and doesn't really negate what was said though, the second post already notes the push should be requiring more sustainability efforts on corpos. like generally corpo/scale sustainability efforts are also FAR more meaningful than individual ones

Ariel M. (she/her)
@byarielm.fyi

and it's (in a better sociopolitical climate....) really easier to get corpo/scale to change their energy/environmental impact than it is individuals. like you might have your local inference on solar power but i'd guess, if widespread local inference, vast majority wouldn't