Post

People have real qualms with AI detectors, and so do I, but the evidence is mounting that Pangram in particular very rarely gets it wrong (especially on longer chunks of text, but increasingly even on short ones). @brianx.bsky.social tested it and it didn't miss: www.nytimes.com/2026/08/13/t...

nytimes.comI Tested a Popular A.I. Slop Detector. It Felt Empowering.Pangram excels at distinguishing chatbot-generated words from human writing. But it’s not reliable for spotting artificial images.

57 reposts243 likes

So now make it a browser extension and set it to block all links with AI content, and we have a killer idea! FB, Instagram and Bluesky should implement it to automatically block AI posts and we will laude them as the saviors of society.

I'm interested in identifying the rates of self-handicapping. Most of the students in my lab also take coding courses and have fessed up to using humanizing software or creating poor/inefficient code simply to minimize the likelihood of detection/

Still works for me: bsky.app/profile/cv-d...

C.V. Danes@cv-danes.com

You know what gives AI away? When you're reading something and all of a sudden you come across a paragraph that has no possible reason to be there. Like reading about F1 racing and suddenly getting advice on how to be a better listener.

I wrote about this as a critic of slop & detectors. To your good Q’s: even rare false positives scale up (1 in 100 is a lot in a million); second, it’s an arms race: LLMs will learn what not to do, breaking any detection infrastructure we opt to depend on. mail.cyberneticforests.com/its-not-just...

mail.cyberneticforests.comIt's Not Just X. It's Y.Against the Quantification of Integrity When the measure of language becomes its target, it ceases to be good language. 💡Nerd Rating: 1/5. I discuss the origins of certain linguistic tics in LLMs a...

But top of my list is the effect detection has on the way we naturally write; which is secondary to detection, but that it turns us away from writing that “sounds like an LLM,” even though LLMs are optimized via RLVR on reasoning language and so produce efficient, *logical sounding* outputs.

That's a fair worry. FWIW like a lot of journalists I use em-dashes, negative parallelism and triads regularly. So far I have not seen Pangram flag any of my articles as being other than 100% human-written. I wonder if it could actually save us from relying so much on crude heuristics to clock AI?

For pro writers, less of an issue. From the pov of its most-used domain, student writing — kids growing up in this environment without having their skin thickened or language mastered — if the risk of automated false positives influences how they write, that’s a net loss.

Additional question on this--I see only one mention (Dickens) of trying a book text? The biggest place it's coming up contentiously right now is in publishing, especially after your Daggermouth piece. Where it's also still not clear how much that flagged as generated vs. assisted...

I think showing something like "we tested 10,000 books from 2021 and there were zero false positives. And here we tested 10,000 guaranteed human books from after 2022 and again, zero false positives" would go a long way in terms of trust!

Good, they are intentionally weighted toward avoiding false positives which is vital. Sloppers trying to be like "I slopped and it didn't see my slop" as some kind of gotcha is very funny.

AI detectors rightly got a bad rap because they got it wrong often enough to be worse than useless — actively harmful. Pangram has a different algorithm that by all accounts simply works much better. I'd still be wary of basing an accusation on Pangram alone, but... www.nytimes.com/2026/07/29/b...

Pangram's new model was only just released 7/29/2026. There basically hasn't been any opportunity yet for the failure modes of this AI detector to present themselves. "By all accounts" is an irresponsible claim when there are no real accounts available.

The case for using Pangram as at least an indicator of likely AI writing is much stronger than it was for Turnitin/GPTZero. Its widespread use would also deter a lot of folks from even trying to pass off AI slop as authentic. Is that enough to justify it, or is any nonzero error rate intolerable?

The thing I worry about here is, it’s an arms race: as the LLMs get better, Pangram will get worse, probably even as they retrain it.

It might sound like a rhetorical question but I'm genuinely interested in how folks answer it. Obviously purveyors of AI writing don't want this. But what about people who hate AI slop but also disapprove of AI use in general, or worry deeply about false accusations? How do you weigh the tradeoff?

> Obviously purveyors of AI writing don't want this. Strong disagree. I'm extremely excited about these technologies, and also think it's a good thing when their application is transparent and detectable. *Plagiarists* don't want this. It's completely orthogonal to supporting AI.

The false accusation concern is real. The “disapprove of AI use in general” suffers from the overly-broad application of the term “AI”: the description of how Pangram use is designed (NB I haven’t read past that yet) is much more like “old school” machine learning than the LLM-driven AI tools.

This is a great question. I'd love to see research on Pangram's accuracy for non-native speakers specifically. Logically its error rate couldn't be *that* high or else its overall error rate couldn't be so miniscule. But any amount of bias makes the tool's use problematic from a fairness standpoint.

This post is unavailable.

I hate AI slop, but I also tend to believe people are innocent until proven guilty. I can see this ruining some innocent person's career. How do you prove you didn't use AI?

The main reason I don't like algorithmic detection is that it implies only an "AI" would be able to tell. This grants extruded prose false equivalence to prose that came from a mind. We should be teaching people how to see that the prose did not come from a mind.

The problem with the folk taxonomy that has sprung up around this, counting em-dashes and overused words and suchlike, is that it treats "AI" as if it is a mind with a quirky writing style. We naturally assume that there is a mind behind fluent prose, so the absence of one isn't intuitive.

But it is often possible to tell if you know what to actually look for; the artefacts that are a result of the lack of intentionality in the writing, the absence of a world model. And yes, once you know, sometimes you can tell lack of concept apart from human misconception.

The naive stylometry that has led to false accusations and witch hunts has left people thinking it's never possible to just tell. Actually, because the concept of prose that did not come from a mind is so new and alien, people have just been looking for the wrong markers.