Post

One of the reasons AI began to be used in moderation everywhere is because in the 2010s there were atrocious articles describing the absolute hell human reviewers were going through and how they all had PTSD

NOT Lenny Bruce 🏳️‍⚧️🌈@notlennybruce.bsky.social

Maybe this job needs more of a human touch and less of an AI touch.

38 reposts309 likes

do people not know Mets used to be the baddies bc of what their human reviewers were experiencing

You are using the specter of the FBI misusing AI to argue against the use of AI for content moderation, but in doing so, you implicitly conflate the very minor consequences of online platform TOS enforcement with the very severe consequences of being entangled in the US court system

Not to mention literal crime rings in other countries abusing and extorting workers Anyone that posts we need to go backwards on moderation needs to be literally duct taped to an IKEA chair to watch 12 hours of twitter, clockwork orange style, or lose their home

I mean that's what we were doing to people in other countries. Seems fair.

There are a number of places that use an AI or even just an old fashioned Bayesian layer to filter the truly heinous, but have a small-scale human layer on top. Reddit and Mastodon spring to mind (YMMV on Mastodon's spam/heinous content-filtering)

Having experienced it, mastodons moderation is almost entirely human-driven, however it has the very powerful tool of defederation, which makes it a lot easier to ban entire classes of users.

people come back from wars less fucked up than content moderation was doing to people over time, yeah, especially if they were having to deal with significant volumes of CSAM

i think if you're honest with yourself just asking "how much would you have to pay me to think about the worst online interaction I've ever had for eight hours a day" would reveal that this is a dogshit job even before accounting for how much worse the internet gets than your worst interaction

my answer would be a number high enough that i don’t need to do it for more than 5 years maximum before i can retire to a cabin in the woods, personally

Sometimes I have to spend a whole day reading through emails which are all irritated, mixed in with some irate ones thrown in, and even that low level but high volume of negative communication has a noticeable impact. High level, high volume must be horrible