Post

small models will soon be able to self-replicate Anthropic finds that 30B models can currently do most of the tasks required, but not end-to-end. they think models as small as 9B (9-18 GB) may be able to do it on edge hardware, like IoT devices, within months www.anthropic.com/research/sel...

anthropic.comAI models may be capable of self-replicating without access to a datacenterSmall AI models may be only months away from being able to self-replicate across cheap IoT devices like Android TV boxes, with no datacenter needed.

tannerr.dev

@tannerr.dev

so we dont need giant data centers? iot devices are enough?

mr. TIM

@timkellogg.me

a lot of bad takes here, but small = inefficient if you care about the environment, you should advocate for huge centralized datacenters

tannerr.dev

@tannerr.dev

reusing old devices sounds renewable

mr. TIM

@timkellogg.me

you have to understand the extent to which datacenters optimize for costs, cut losses, etc. it’s their entire business and they have sophisticated business apparatuses dedicated to optimizing things like, what to do with old hardware, highly engineered power utilization, heat, etc.

14/10/26, 1:10 am0 reposts1 like

mr. TIM

@timkellogg.me

whereas the average IoT home simply forgets that 3/4 of their devices are even plugged in, has no idea what the power draw is, and typically disposes of them into a landfill

mr. TIM

@timkellogg.me

most people see “small” and assume it’s good. But there’s so many things you can do at scale that simply aren’t possible in the home