Well this is depressing. "Participants were no better than chance at differentiating between the human-written and AI-generated stories."
Post
This study used a platform called Prolific, where people sign up to get paid small fees to do AI surveys, & they're incentivized to do them rapidly so they can complete more surveys to get more payments. These studies using Prolific have *very* questionable methodology & I would not read into them.
0 reposts3 likes
I'll add that you can read the stories yourself here. The AI ones don't come across as obviously fake if you read them quickly, but they're quite bad and some of the sentences don't make sense if you stop to think about them. osf.io/d8f6m/overview
For example "A record spun lazily in the corner, the soft crackles of the needle the only sound filling the silence." That sentence doesn't make sense (isn't there music coming out of the record?), but if you're just reading as quickly as possible to finish the task and get paid you might miss that.