Post

datacenter inference is and will probably always be less environmentally destructive than local inference btw. the environmentalist option is not 'local AI'.

this is why actually regulating datacenters is a lot more important than banning them. banning them is stupid. please just set reasonable floors for % renewables!

fwiw, I am not saying no to local AI there are a million reasons why local AI is desirable in some capacity. I am an ops freak and love making my computer fan go spinny running a model it has no business running. I want my phone's features to work offline. I don't like daddy jensen etc.

but you guys are actually deluding yourselves. like you are just not correct on the face of it.

i think the biggest delusion is expecting the capabilities of the average consumer's device to leap forward by such a massive amount within 5 years, even considering any potential optimizations in locally-hosted models