Post

Pretty cool project on /r/localllama - they take human written text and sloppify it 10x with 4o-mini, then train the model to de-slop by reversing the transformation

base models get zero love. depressing

as it is, the latent potential of base models is yet to be fully realized. Opinions may change as understanding spreads. The key is to craft prompts in such a way as to flow inference along a trajectory that elicits a capacity without running into a low entropy basin entropy basin basin basin basin