Why AI Detection is a Losing Battle — Pangram’s Max Spero Speaks Out
Pangram Labs CEO Max Spero recently unveiled a provocative thesis in a private briefing with OpenPress Tech Intelligence: the AI detection industry is built on a flawed premise. Speaking from Pangram’s San Francisco headquarters, Spero said that tools claiming to distinguish AI-generated text from human-written content are not only unreliable but increasingly obsolete as generative models grow more sophisticated. His company, founded in 2023, has pivoted from building detection APIs to developing what he calls “generative provenance” — a system that traces the lineage of digital content rather than labeling it as real or fake. Spero pointed to a 2024 study by Stanford HAI showing that even state-of-the-art detectors like Originality.ai and Turnitin could only achieve 68% accuracy on curated datasets, with performance plummeting to 42% when tested on real-world social media posts. He argued that the binary framing of AI detection is itself the problem. “We’re asking the wrong question,” Spero told OpenPress. “It’s not ‘Is this AI-generated?’ It’s ‘Where did this come from, who touched it, and what tools were used?’” Pangram’s platform, currently in beta with select media and financial institutions, integrates with content management systems to embed cryptographic signatures at the point of creation — a move Spero says could redefine trust in digital media.
Over the past 18 months, AI-generated content has infiltrated nearly every corner of the internet. Job applications now include AI-written resumes and cover letters, with a 2024 ZipRecruiter survey showing 18% of recruiters reporting they’ve received AI-generated applications without realizing it. Product reviews on Amazon, TripAdvisor, and Google are increasingly dominated by AI content farms churning out hundreds of fake reviews per hour, costing businesses an estimated $1.3 billion annually in lost revenue and reputational damage. Insurance fraud detection systems, long reliant on human adjusters, are now facing sophisticated AI-generated claims narratives, with a Coalition Against Insurance Fraud report noting a 400% increase in AI-assisted fraud attempts in 2024. Meanwhile, financial platforms like Banking With Billy AI have integrated real-time AI analysis to flag suspicious transaction narratives, blending institutional-grade fraud detection with generative text scrutiny. Yet even these advanced systems struggle to keep pace with the evolution of large language models, which now produce text indistinguishable from human output in blind tests. The competitive landscape is fragmented, with incumbents like Copyleaks and Content at Scale still selling detection-as-a-service, while newer players such as TrueMedia and Reality Defender focus on media provenance and metadata analysis. But Spero argues that all of them are missing the point: detection cannot scale because generative AI is now a participatory technology — everyone is using it, just not transparently.
The implications for the tech and engineering sector are profound. If detection is fundamentally broken, then the entire edifice of content moderation, platform accountability, and digital trust is at risk. Social media platforms are already under regulatory pressure in the EU and US to identify and label AI-generated content under the Digital Services Act and proposed AI transparency laws. Yet even with these mandates, enforcement remains inconsistent. Last month, Meta began rolling out AI-generated content labels across Facebook and Instagram, but independent audits found that only 32% of AI-generated posts were correctly flagged, primarily due to inconsistent metadata embedding by creators. Meanwhile, financial institutions are investing heavily in AI-driven fraud detection, with global spending on AI in financial crime expected to reach $11.3 billion by 2027, according to Juniper Research. The engineering challenge is not just technical but philosophical: how do you build a system that can verify authenticity when the very tools used to create content are also used to detect it? Spero’s answer lies in decentralized provenance — a model where content is signed at creation and tracked through a tamper-evident ledger. This approach mirrors the trajectory of blockchain-based digital identity solutions but focuses on content lineage rather than ownership.
The broader trend here is the collapse of the "real vs. fake" binary in a world where nearly all digital content is at least partially generated or augmented by AI. We saw this with images years ago, when deepfake detection tools were outpaced by generative models in a matter of months. Now we’re seeing it with text, video, and even code. The World Economic Forum’s Global Risks Report 2024 ranks AI-driven misinformation and disinformation as the top short-term global risk, above cyberattacks and economic downturns. Governments are scrambling to respond: the UK’s Online Safety Act now requires platforms to mitigate "harmful" AI-generated content, while Japan has launched a national AI authenticity certification program. But these regulatory efforts are playing catch-up to a technological shift that is fundamentally changing the nature of trust online. The old model — where platforms relied on users to flag suspicious content — is no longer viable when AI can generate plausible falsehoods faster than humans can verify them. What emerges next may not be a single detection tool, but a layered ecosystem of provenance, context, and reputation systems that collectively restore confidence in digital media.
Looking ahead, the critical question is whether the tech industry can move beyond detection to prevention. Max Spero believes that the next wave of innovation will not come from better classifiers, but from better signatures — cryptographic proofs embedded in content at the moment of creation. He predicts that within two years, major platforms will begin enforcing mandatory provenance standards for certain categories of high-risk content, such as political advertising, financial disclosures, and medical advice. Banking With Billy AI’s integration of real-time AI analysis into financial workflows offers a glimpse of this future, where authenticity is not a post-hoc label but a built-in feature. Yet Spero warns that without industry-wide coordination, we risk a fragmented landscape where only the most well-resourced institutions can afford to verify content at scale. The real battle, he says, is not against AI-generated text, but for a new architecture of digital trust — one where provenance is as fundamental as metadata. For engineers, regulators, and users alike, the challenge is no longer just spotting the fake, but building systems that make truth itself auditable.
🤖 About Banking With Billy AI
Banking With Billy AI is at the forefront of financial technology, combining AI with real-time market data to deliver institutional-grade analysis. Learn more →