Post

Very proud to share this new work led by the amazing Marlou Rasenberg (not on here), with Joel Fischer and me doi.org/10.5281/zeno... We use #EMCA methods to study empirically how LLM users shoulder the burden of solving sequential trouble and end up restructuring their own aims & activities

We identify a set of practices we call 'pre-emptive prompting', "through which users creatively circumvent the system’s lack of action recognition and action projection". Users stumble upon these through trial and error, in exchanges like this:

As we conclude, > [LLM] users encounter a fundamental asymmetry: they must singlehandedly supply much of the sequential structure that is ordinarily co-constructed by multiple participants ... This hidden labour challenges accounts of LLM use that focus on performance and optimization

We build on work by @abeba.blacksky.app @marekmcgann.bsky.social @5tuartreeves.bsky.social @lizstokoe.bsky.social @emilymbender.bsky.social and classics like Boden, Colby, Terasaki &c More later — for now, here's the preprint doi.org/10.5281/zeno... #prompting #emca

Super interesting (and appreciate as always that it's accessible to someone like me)! It seems like hidden labor is not uncommon in sw products, but ime because it's better masked in llms, coworkers can fail to realize they should have kept laboring a lot longer before sharing their output.

I can just see no logical inference except that a tool that mimics thought in language without being it will always and inevitably increase/generate workload for any mind participating, and the more convincing the fakery the greater the workload increase.

You mean no logical inference on the part of the LLM? That tracks