What if the Anti-AI Writing Police Make a Mistake? (cnn.com) 8
Writing contests face "a literary version of the ruined world" in Blade Runner, writes CNN. "Anxiety and suspicion about robot infiltrators are everywhere — and so are people claiming to hunt the robots down."
Multiple companies now offer products that promise to spot the difference, with often contradictory, biased or erratic results. The makers of Pangram, an AI detection platform that has been cited as authoritative in many of the recent controversies, claim it can distinguish between human and synthetic writing with near-perfect accuracy... The company's own estimates claim that false positives — in which the tool wrongly reports that a piece of human writing was created — are 1 in 10,000 and shrinking. Peer-reviewed studies from the University of Chicago and the University of Brussels support that claim, though one 2025 study from the University of Maryland found that Pangram erroneously labeled 2% of documents as AI.
A widely referenced 2023 Stanford study that found AI writing detectors produced higher rates of false positives on writing from non-native English speakers was conducted before Pangram was created. Pangram ran an internal study using a database of non-native English texts and self-reported that false positive rate was around 8 in 10,000... Given the thousands upon thousands of pieces of writing published each day, a 1 in 10,000 chance of a false accusation — let alone an 8 in 10,000 chance — means that even the most trusted AI detector is going to be wrong, and wrong about a lot of people.
Pangram isn't able to tell users the truth about someone's writing, but it is able to introduce something much more complicated: doubt. Unless an accused writer confesses to using an LLM, there is no bulletproof way to prove an accusation, short of being given full access to someone's computer history and finding the chatbot prompts... To some people and institutions on the literary side, using automated AI writing detectors to fight the influx of AI writing is just trading one form of technological domination for another.
Pangram "has entered the public consciousness at a time of distrust that goes beyond writing," CNN notes, when people want to block "at least some of the daily overflow of misinformation and misrepresentation" recently studied by John Warner, the author of More Than Words: How to Think About Writing in the Age of AI .
But he's one of the people who believes AI-detecting tools can create a new dependence on another kind of machine. "Like all other technology of automation, that is going to de-skill people from discerning these things for themselves."
A widely referenced 2023 Stanford study that found AI writing detectors produced higher rates of false positives on writing from non-native English speakers was conducted before Pangram was created. Pangram ran an internal study using a database of non-native English texts and self-reported that false positive rate was around 8 in 10,000... Given the thousands upon thousands of pieces of writing published each day, a 1 in 10,000 chance of a false accusation — let alone an 8 in 10,000 chance — means that even the most trusted AI detector is going to be wrong, and wrong about a lot of people.
Pangram isn't able to tell users the truth about someone's writing, but it is able to introduce something much more complicated: doubt. Unless an accused writer confesses to using an LLM, there is no bulletproof way to prove an accusation, short of being given full access to someone's computer history and finding the chatbot prompts... To some people and institutions on the literary side, using automated AI writing detectors to fight the influx of AI writing is just trading one form of technological domination for another.
Pangram "has entered the public consciousness at a time of distrust that goes beyond writing," CNN notes, when people want to block "at least some of the daily overflow of misinformation and misrepresentation" recently studied by John Warner, the author of More Than Words: How to Think About Writing in the Age of AI .
But he's one of the people who believes AI-detecting tools can create a new dependence on another kind of machine. "Like all other technology of automation, that is going to de-skill people from discerning these things for themselves."