I continue to believe that role play—improv if you will—is the best way to think about what LLMs are doing. What is startling and interesting is that this facility for role play, combined with huge amounts of data, allows these models to simulate consciousness and expertise so convincingly.
Just to be very explicit, my claim is that the one simplest and best explanation for this, which resolves any apparent strangeness entirely, is that whoever is “speaking” in LLM output is a fictional character, and the real life thing called an LLM is a machine for writing lil stories about that guy
1 repost3 likes