Post

@thorstenball.com

nature vs. nurture but training vs. system-prompt

2/5/25, 9:09 am2 reposts8 likes

Related arxiv.org/abs/2505.00661

arxiv.orgOn the generalization of language models from in-context learning and finetuning: a controlled studyLarge language models exhibit exciting capabilities, yet can show surprisingly narrow generalization from finetuning -- from failing to generalize to simple reversals of relations they are trained on,...