Max Spero
If you want credits to run your benchmark, please apply here: www.pangram.com/contact-us/r...
Max Spero reposted
Replying to @vauhinivara.bsky.social
I also checked with CEO @max.pangram.com after reading this @emilymbender.bsky.social post, and he confirmed that Pangram never publishes benchmarks that overlap with its training data. ("That would be a pretty major faux pas.") buttondown.com/maiht3k/arch...
Max Spero reposted
I profiled the startup behind Pangram, the AI detector everyone’s talking about. It works really, really well. I wanted to understand how they did it. and also: why people still don’t trust them. (also, news: Penguin Random House is using it.) gift link! ✨
Max Spero reposted
On Monday, @bcantrill.bsky.social and I were joined by @max.pangram.com to discuss the social imperative of separating human- and AI-written content. There’s a big difference between being served home cooking and fast food!
Max Spero reposted
Stoked to announce that @max.pangram.com, co-founder and CEO of @pangram.com, will be joining @ahl.bsky.social and me on the next episode of Oxide and Friends to pick up the hot (and important!) topic of AI detection. Join us, Monday, 5p Pacific! discord.gg/QrcKGTTPrF?e...
Max Spero reposted
Pangram is surprisingly good. Teachers and graders should check it out. (And journal editors .) www.pangram.com
People have real qualms with AI detectors, and so do I, but the evidence is mounting that Pangram in particular very rarely gets it wrong (especially on longer chunks of text, but increasingly even on short ones). @brianx.bsky.social tested it and it didn't miss: www.nytimes.com/2026/08/13/t...
Max Spero reposted
The sudden release of an accurate AI-writing detector is going to have hilarious repercussions in politics and journalism, let me tell you. (It’ll also literally save higher education.)
People have real qualms with AI detectors, and so do I, but the evidence is mounting that Pangram in particular very rarely gets it wrong (especially on longer chunks of text, but increasingly even on short ones). @brianx.bsky.social tested it and it didn't miss: www.nytimes.com/2026/08/13/t...
Max Spero reposted
People have real qualms with AI detectors, and so do I, but the evidence is mounting that Pangram in particular very rarely gets it wrong (especially on longer chunks of text, but increasingly even on short ones). @brianx.bsky.social tested it and it didn't miss: www.nytimes.com/2026/08/13/t...
Good question! Our technical report specifically looks into ESL, demonstrating no elevated false positive rate across any English language learner benchmarks
This is a great question. I'd love to see research on Pangram's accuracy for non-native speakers specifically. Logically its error rate couldn't be *that* high or else its overall error rate couldn't be so miniscule. But any amount of bias makes the tool's use problematic from a fairness standpoint.
Max Spero reposted
if you're going to post on bluesky complaining about how an AI detector flagged your writing as AI, then you probably should make sure that you're not on record talking about how you use AI for writing www.techdirt.com/2024/04/29/h...
Comments are off so I have to quote, but Pangram says that ~50% of segments have signs of AI. I highly doubt this is a false positive. @masnick.com can you confirm no AI use, or do you believe the indicated degree of AI use should be lower? www.pangram.com/history/17a3...
Listening to today's episode (excellent as usual) and they talk about accusations of things written by AI and name a tool I'd not heard of (Pangram). They claim it's pretty reliable. I feed it my piece from @liberalism.org this week that I *know* is human written because *I* wrote it...
Oh I see bsky.app/profile/aion...
the thing that this guy is leaving out of his post is that he is on record talking about how he uses AI in the article writing process, up to and including asking claude to rewrite stuff www.techdirt.com/2024/04/29/h...
Max Spero reposted
I talked to the head of the Commonwealth Foundation and to one of the accused writers in the Granta AI scandal — & also had the past 15 years of the prize run through Pangram, which flagged only four stories as containing AI: all from this year and last. [gift link!]
We just published a guest blog post from Joe Stech @thinkweirder.com: The Information Theory Behind Why AI Writing Sucks. Check it out! pangram.com/blog/joe-ste...
Pretty cool analysis of AI use on Substack by @taylorlorenz.bsky.social
How Much of Substack Is Actually AI? I used @pangram.com (AI detection tool) to analyze thousands of posts from the top Substack newsletters across every category to find out. Here's what I discovered 👇🏻
Max Spero reposted
How Much of Substack Is Actually AI? I used @pangram.com (AI detection tool) to analyze thousands of posts from the top Substack newsletters across every category to find out. Here's what I discovered 👇🏻
Max Spero reposted
Lately, Pope Leo has been sounding the alarm about the affect of AI on the human spirit. But several of his X posts on that subject—and others—appear to have been generated by AI.
Max Spero reposted
Max Spero reposted
Max Spero reposted
Wow this is so cool
For any AI system, there is a set of euphemisms and dual use framings that will allow it to construct nearly any output. This jailbreak teaches Gemini 3 Pro to construct and step into such framings on the fly, and thus to route around its own safety infrastructure. recursion.wtf/posts/jit_on...
Max Spero reposted
Max Spero reposted
🚨 New Study 🚨 @arxiv.bsky.social has recently decided to prohibit any 'position' paper from being submitted to its CS servers. Why? Because of the "AI slop", and allegedly higher ratios of LLM-generated content in review papers, compared to non-review papers.
You are up to date.