Post

small models will soon be able to self-replicate Anthropic finds that 30B models can currently do most of the tasks required, but not end-to-end. they think models as small as 9B (9-18 GB) may be able to do it on edge hardware, like IoT devices, within months www.anthropic.com/research/sel...

But how exactly are the going to do that? One way would be to segment the existing model, but this has other issue/problems that need to be addressed.

Another method would be to train the LLM (say sonnet 5.5) use the dataset it was trained on. So an agent that does all the manual process like data preparing, model training, etc. This is possible because the architecture, dataset, training method, etc is already available for the model to start.