Post

dame
@dame.is

i assume that the vast majority of consumer AI usage will be entirely local on-device in 5 years (if not sooner)

Ezra🦋
@ezraboeth.com

I don't think this happens without a market crash or political action, but I hope it does! I'd specifically love to see a ban on cloud AI so there's a ton more pressure on engineering to figure out how to make on-device AI work better. there's no reason it can't work once devices are powerful enough

Ezra🦋
@ezraboeth.com

currently, the nature of GPU/CPU architectures mean it's most efficient to serve inference for a large numbers of users on a single cluster of machines, rather than using a single device like a macbook. that could change with enough time and money though. Apple has made strides in this area.

0 reposts0 likes

Ezra🦋
@ezraboeth.com

I just want to see us trying to push more and more intelligence into tinier and tinier boxes, rather than trying to build the biggest boxes we can and to hell with efficiency

Ezra🦋
@ezraboeth.com

bsky.app/profile/ezra...

Ezra🦋@ezraboeth.com

my preferred way of solving the AI craze is federally banning AI *in the cloud* (over a certain amount of resources in one location). AI is still fine but it has to be on end-user devices. only exception is scientific research approved by or funded by government in some way.