Post

aly
@aly.codes

datacenter inference is and will probably always be less environmentally destructive than local inference btw. the environmentalist option is not 'local AI'.

aly@aly.codes

"soon most AI will be local" yeah sure, the way most gaming is candycrush and subway surfers. what is the point here

aly
@aly.codes

this is why actually regulating datacenters is a lot more important than banning them. banning them is stupid. please just set reasonable floors for % renewables!

6 reposts54 likes

aly
@aly.codes

fwiw, I am not saying no to local AI there are a million reasons why local AI is desirable in some capacity. I am an ops freak and love making my computer fan go spinny running a model it has no business running. I want my phone's features to work offline. I don't like daddy jensen etc.

aly
@aly.codes

but you guys are actually deluding yourselves. like you are just not correct on the face of it.

maxwell ⎔
@mfzx.net

i think the biggest delusion is expecting the capabilities of the average consumer's device to leap forward by such a massive amount within 5 years, even considering any potential optimizations in locally-hosted models

aly
@aly.codes

to be generous I think they think that small models will continue getting better which is definitely true

Dio
@interleave.love

Yeah most people think that the small models will get better rather than compute improving. Theres also stuff like custom Asics and stuff that make that option a lot more possible.