Post

Steering vectors can work as activation oracles! Inspired by @isolyth.dev 's recent work on instruct vectors, I've ported the same approach to create Activation Oracles. Seems to work surprisingly well given the param deficit, nearly matching Activation Oracle LoRA performance.

One thing, it might be nice to see baseline/completely untrained models for comparison. How good is qwen on its own at this vs vectors?

I can add some more charts in. IIRC: 0% success rate with yes steering no activations and yes activations no steering at taboo.

Added a new section with this chart.

Can you also put the lora on there maybe?