Hanson Lu

Hanson Lu

@hansonlu.bsky.social

PhD student at Brown | Prev: Tsinghua Uni, Harvard hansonzlu.github.io/about

72 followers635 following3 posts

Hanson Lu
@hansonlu.bsky.social

Our new method, Hessian Null Space Continuation (HNC)! Around any trained network there is a large connected set of weights that compute nearly the same function. HNC walks through this set along flat directions of the Hessian. 1/3

Ann Huang@annhuang42.bsky.social

How much representational diversity exists around a trained network? A lot, it turns out! Moving a ViT’s weights by 1.3% while preserving its predictions, its representations end up less similar to the original than a random-init ViT’s ‼️ New paper: Hessian Null Space Continuation (HNC) 💫🧵 (1/12)

Hanson Lu
@hansonlu.bsky.social

We find distinct solutions/representations, and can steer toward specific properties (sparser networks, different dynamics or behaviors), all while maintaining performance. 2/3

Hanson Lu reposted

Ann Huang
@annhuang42.bsky.social

How much representational diversity exists around a trained network? A lot, it turns out! Moving a ViT’s weights by 1.3% while preserving its predictions, its representations end up less similar to the original than a random-init ViT’s ‼️ New paper: Hessian Null Space Continuation (HNC) 💫🧵 (1/12)

You are up to date.