Post

πŸ“’ New paper: Applied interpretability 🀝 MT personalization! We steer LLM generations to mimic human translator styles on literary novels in 7 languages. πŸ“š SAE steering can beat few-shot prompting, leading to better personalization while maintaining quality. 🧡1/

5 reposts20 likes

πŸ“˜ Literary translation isn't just about accuracy, but also creatively conveying meaning across languages. But LLMs prompted for MT are very literal. Prompting & steering to the rescue! Can we personalize LLM’s MT when few examples are available, without further tuning? πŸ” 2/

πŸ“ˆ But can models recognize and replicate individual translator styles?: βœ“ Classifiers can find styles with high acc. (humans kinda don’t) βœ“ Multi-shot prompting boosts style a lot βœ“ We can detect strong style traces in activations (esp. mid layers) 3/

🌍 Across 7 languages, our SAE-based method matches or outperforms traditional prompting methods! Our method obtains better human-like translations (H) personalization accuracy (P), and maintains translation quality (Comet β˜„οΈ @nunonmg.bsky.social) especially for smaller LLMs. 5/

I love and hate this at the same, bit of double think. On one hand this is a very much needed improvement to translations but on the other hand human translators already get paid so low and this is just another excuse for companies to pay them less.

Indeed, but we also show the other side of the coin: personalized generation and its evaluation remain extremely challenging, and IMO professional human translators are still essential to produce a truly original, publication-ready final work as of today.