Post

This entire thread is an amazing case study in both LLM psychology and recklessly evaluation setups.

Colin@colin-fraser.net

It appears to me that the scenario they invented for this evaluation is explicitly designed to get it to do exactly this. They remove the instructions for the task to "protect the vendor" or something but it's pretty easy to reconstruct from the text.

2 reposts2 likes

No replies yet.