Post

human level not human like - that is an important distinction to keep in mind when discussion AI!

Important in the same way that both planes and birds fly, but using different mechanisms? I'd argue it's not such an important distinction at all! If we ever met intelligent aliens, they would likely not have intelligence exactly like us, but their insights could still be novel & beneficial.

We focus on an important feature of analogical reasoning often called "re-representation" – the ability to dynamically select which features of analogs matter to make sense of the analogy (e.g. if one analog is "horse", which properties of horses does the analogy rely on?). 2/9

We tested humans & LLMs on analogical reasoning tasks that involve flexible re-representation. We strived to apply best practices from cognitive science – designing novel tasks to avoid data contamination, including careful controls, and doing proper statistical analysis. 3/9

In our first study, we tested whether LLMs could map semantic relationships between concepts to symbolic patterns. We included controls such as permuting the order of examples or adding semantic distractors to test for robustness and content effects (see full list below). 4/9