Post

Vector Institute
@vectorinstitute.ai

How does cognitive science help us build better AI? At our 2026 AI Summit & Career Fair, Vector Faculty Member Kelsey Allen broke down how human cognition exposes the limits of current learning systems and how we can fix them. 🧵👇

Vector Institute
@vectorinstitute.ai

Modern models excel at knowledge representation but struggle with physical reasoning. Humans solve novel physical problems easily via accurate mental simulation, a capacity current generative models lack.

0 reposts0 likes

Vector Institute
@vectorinstitute.ai

To bridge this gap, Allen introduced 3DSPA: a 3D Semantic Point Autoencoder. It predicts 3D point trajectories to measure physical realism in generated video, detecting physical rule violations just like a human infant would.

Vector Institute
@vectorinstitute.ai

The outcome? Used as a reward signal with reinforcement learning, 3DSPA measurably improves physical realism in generative video models. Gravity works properly and objects stop passing through solid barriers.