There’s a story making the rounds on Hacker News this week — 794 upvotes, 514 comments, and climbing — that reveals something deeply unsettling about how AI companies are building their training datasets. It’s not about copyright, not exactly. It’s not about privacy, not directly. It’s about something older and more visceral: the physical destruction of rare books.

According to reports, AI companies — or middlemen working on their behalf — have been buying up rare and out-of-print books, scanning them page by page to feed into training pipelines, and then shredding the physical copies.

Not donating them. Not returning them. Shredding them.

The logic is cold and calculated: if only one digital copy exists, there’s no question about whether the training data was obtained legally. No second copy to create ambiguity. No original left to dispute ownership. The physical book becomes a liability. The digital scan becomes the only evidence that the book ever existed in this context.

Welcome to the Bookshelf Fire of 2026.

How We Got Here: A Chain of Bad Incentives

This didn’t happen in a vacuum. To understand why rare books are being destroyed, you have to follow the chain of perverse incentives that led here.

Step one: Publishers sued AI companies for training on shadow library data — datasets like Books3, built from pirated copies. The lawsuits were aggressive and high-profile. Authors Guild. The New York Times. Individual writers who found their copyrighted work in training sets.

Step two: AI companies got the message. They stopped relying on shadow libraries and started acquiring content through more defensible channels. Deals with publishers (like OpenAI’s partnerships with Axel Springer, Dotdash, and the Financial Times). Licensed data agreements. And — for the niche, out-of-print, orphaned works that no publisher could license — they started buying physical copies.

Step three: A legal theory emerged that scanning a physical book for training purposes, then destroying the original, creates a defensible fair use claim. The argument goes: if the physical copy no longer exists, there’s no market harm because there’s no competing product. A federal judge has reportedly cited this reasoning in at least one ruling.

The result? A booming underground market for rare books — not for collectors, but for paper shredders.

The Scale Is Larger Than You Think

We’re not talking about a few dozen first editions. We’re talking about millions of books. The Tom’s Hardware investigation (currently the only mainstream tech outlet covering this) reports that AI companies have outsourced book acquisition to middlemen who scour library sales, estate sales, university discards, and used bookstores.

These middlemen operate under nondisclosure agreements so tight they can’t even acknowledge which AI company they’re working for. Books are purchased in bulk, shipped to undisclosed scanning facilities, digitized at industrial scale — and then destroyed.

The economics work because training data scarcity is the bottleneck. The frontier AI labs have already scraped most of the public web. Reddit. Wikipedia. GitHub. Common Crawl. Stack Overflow. The low-hanging fruit is gone. To train the next generation of models — models that reason more deeply, write more naturally, and generalize better — they need higher-quality data. And there’s no higher-quality text than published books.

According to estimates from the AI data market, high-quality text datasets are now trading at $5-15 per million tokens, up from pennies just two years ago. A single rare book that cost $200 to acquire might yield 500,000 tokens of training data — making the economics comparable to licensed data deals, with the added benefit of legal defensibility through destruction.

The Legal Loophole That Makes This Possible

The fair use argument here rests on a specific interpretation that’s both clever and deeply troubling: if you destroy the original after digitizing it, you’ve eliminated any potential market harm.

Here’s the reasoning:

Fair use analysis considers four factors:

1. The purpose and character of the use — Transformative? Training AI is increasingly considered transformative.
2. The nature of the copyrighted work — Published works get less protection than unpublished ones. These books are published.
3. The amount used — Entire books are scanned, which cuts against fair use.
4. The effect on the potential market — This is the key one. If the physical book is destroyed, there’s no market for it. No competing digital version. No lost sales.

By eliminating factor four, the AI companies create a scenario where the balance tips toward fair use — even though an entire book was copied and no one will ever be able to read the original again.

The HN discussion on this thread is worth reading in full. 514 comments and counting, with opinions ranging from “this is a tragedy for human knowledge” to “old books that nobody was reading anyway are being put to better use.” One commenter who claims to work in the industry writes: “The publishers sued AI companies for training on shadow library data, hoping to negotiate content deals for big money down the line. Instead, they got a world where the books are just destroyed. Congrats, publishers. You played yourself.”

What’s Actually Being Lost?

This is where the story gets personal for anyone who cares about knowledge preservation.

The books being targeted aren’t bestsellers. They’re not even in print anymore. They’re the orphaned works — niche academic monographs, out-of-print technical manuals, regional histories, botanical texts from the 18th century, poetry collections from small presses that went under decades ago.

These are exactly the books that libraries struggle to preserve because they have no commercial value. They’re the books that a single copy might exist in a university library’s special collections — or, increasingly, they don’t exist in any library at all, because the AI middlemen got there first.

When an AI company buys and shreds a rare book, that knowledge isn’t lost — but it’s no longer publicly accessible. It’s locked inside a proprietary training set, accessible only through a model’s API. You can’t browse it. You can’t cite it. You can’t rediscover it. You can only ask the model to summarize it for you — assuming the model retained that particular piece of information and didn’t compress it into a statistical pattern.

This is the opposite of what libraries do. Libraries preserve. They share. They make knowledge available across generations. The AI shredding pipeline takes knowledge that was barely surviving and converts it into a non-renewable resource for private models.

The Internet Archive Connection

You can’t tell this story without talking about the Internet Archive.

The Archive’s Open Library project — which scanned physical books and lent them digitally — was sued by publishers in a case that went all the way to the Second Circuit. The ruling was a disaster for digital preservation: the court found that Internet Archive’s controlled digital lending was not fair use, because it created a competing digital market.

The irony is staggering. A nonprofit library that scanned books to make them available to the public lost its fair use defense. Meanwhile, for-profit AI companies are scanning and destroying books behind NDAs, and the legal system appears to be giving them cover through the same fair use framework that the Archive was denied.

One HN commenter put it bluntly: “That’s why archive.org should have never been sued for lending books they had a physical copy of. This is the result. Publishers should be more careful about what they wish for.”

The Data Scarcity Crisis Nobody’s Talking About

Underneath the moral panic about book destruction is a more fundamental story about AI development: we’re running out of data.

The Epoch AI research group has been tracking this for years. Their latest estimates suggest that high-quality text data will be exhausted by 2026-2028. The frontier labs have already consumed most of the internet. What’s left is either low-quality (social media noise), locked behind paywalls (scientific papers, news archives), or physical (books that were never digitized).

The book-shredding pipeline is a direct response to this scarcity. AI companies aren’t destroying books because they’re evil. They’re doing it because they’ve exhausted every other source of high-quality text and the pressure to build better models is relentless.

This is what happens when you tell an industry “build something better” without asking “at what cost?”

The Ghost in the Scanner: How the Pipeline Actually Works

To understand this story, you need to follow the chain from a dusty library sale to a neural network weight file. It’s a supply chain designed for maximum opacity.

Step one: Acquisition. Middlemen — often operating as shell LLCs with innocuous names — attend estate sales, university library discards, and used bookstore closures. They bid in bulk, often paying above market rate. A university library that normally sells discard books for $1-5 each might get offers of $10-20 from these buyers. The sellers rarely ask questions.

Step two: Triage. Books are sorted by perceived value for AI training. Technical manuals, academic monographs, specialized reference works, and out-of-print literary fiction rank highest. Mass-market bestsellers and books already widely available in digital form are lower priority. The selected books go to scanning facilities. The rest — and many valuable books are likely missorted — go straight to shredding.

Step three: Industrial scanning. These aren’t the flatbed scanners you remember from the library. Industrial book scanners can process 1,000-3,000 pages per hour. They use overhead cameras with page-turning robots, capturing both pages simultaneously at 300-600 DPI. A single facility can digitize an entire library of 50,000 books in under a month.

Step four: OCR and processing. The scanned images run through OCR pipelines, cleaned, formatted, and fed into training datasets. Any metadata — author, publisher, ISBN, publication date — is stripped. The goal is clean text, not bibliographic context.

Step five: Destruction. Industrial shredders reduce the physical books to pulp. The paper waste is typically recycled, closing the loop with grim efficiency. No trace remains except the digital copy — owned by a company you’ll never name, for a purpose you can’t verify, used to train a model you’ll only ever access through an API.

The entire operation is designed to be invisible. No logos. No public records. No paper trail from book to training set.

The Open Source AI Angle: Why This Hurts Small Players Most

Consider this from the perspective of someone building an open source LLM. They can’t afford to buy and shred rare books. They can’t even afford to license high-quality training data at $5-15 per million tokens. They rely on what’s publicly available: Common Crawl, Wikipedia, Project Gutenberg, the Internet Archive.

But the Internet Archive is under legal siege. Common Crawl is getting filtered and reduced as websites block crawlers. Project Gutenberg only has books that are in the public domain — which means most 20th and 21st century knowledge is off-limits.

The companies with the most money get access to the best data, and they make sure no one else can get it by destroying the originals. This isn’t about building better AI. It’s about building a moat around the training data supply.

Open source AI advocates have been warning about this for years. The cost of training data, they argued, would eventually become the real barrier to entry — not compute, not talent, not algorithms. We’re watching that prediction come true in real time, one shredded book at a time.

What the Data Tells Us

The economics of this practice are surprisingly transparent, even if the operations aren’t.

Cost of a rare or out-of-print book: $5-200 (bulk purchase discounts apply heavily at scale)

Scanning cost per book: $1-3 (industrial-scale scanning is cheap)

Tokens per book: 50,000-500,000 depending on length

Effective cost per million tokens: $2-40, compared to $5-15 for licensed data from publishers

The economics work. But the hidden cost is the destruction of cultural heritage. A book that’s scanned and shredded contributes to exactly one training run, while a book that’s scanned and preserved in a library could contribute to a thousand — for open source projects, for researchers, for historians, for curious readers.

The AI industry is making a choice here, and it’s the wrong one. The choice isn’t between training data and book preservation. It’s between private, ephemeral access and public, permanent access. The technology to scan without destroying has existed for decades. The choice to destroy is purely legal, not technical.

What Comes Next?

Several things need to happen — and fast.

First, the scanning needs to be separated from the destruction. There’s no technical reason why a scanned book can’t be donated to a library or returned to the seller after digitization. The destruction is purely a legal strategy, not an operational necessity. Laws requiring digitized books to be preserved in public archives after scanning for AI training would close the loophole without banning the practice entirely.

Second, the fair use theory needs scrutiny. A court should examine whether destroying the original actually strengthens a fair use claim, or whether this is an end-run around copyright law that judges never anticipated. The US Copyright Office has already been asked to weigh in on AI training data issues — this should be on their agenda.

Third, we need alternatives to secret training sets. The data scarcity problem isn’t going away. If anything, it’s going to get worse as more AI companies compete for the same finite pool of high-quality text. Open source projects like Common Corpus and the Open Library’s digitized collections show that shared data pools are possible — but they need funding, legal protection, and industry participation.

Fourth, libraries need protection. If AI companies are outbidding libraries for rare books at estate sales and university discards, the result isn’t just fewer books on shelves — it’s fewer books full stop. Libraries should have a right of first refusal on any book that’s being acquired for AI training purposes.

Several things need to happen — and fast.

First, the scanning needs to be separated from the destruction. There’s no technical reason why a scanned book can’t be donated to a library or returned to the seller after digitization. The destruction is purely a legal strategy, not an operational necessity. Laws requiring digitized books to be preserved in public archives after scanning for AI training would close the loophole without banning the practice entirely.

Second, the fair use theory needs scrutiny. A court should examine whether destroying the original actually strengthens a fair use claim, or whether this is an end-run around copyright law that judges never anticipated. The US Copyright Office has already been asked to weigh in on AI training data issues — this should be on their agenda.

Third, we need alternatives to secret training sets. The data scarcity problem isn’t going away. If anything, it’s going to get worse as more AI companies compete for the same finite pool of high-quality text. Open source projects like Common Corpus and the Open Library’s digitized collections show that shared data pools are possible — but they need funding, legal protection, and industry participation.

Fourth, libraries need protection. If AI companies are outbidding libraries for rare books at estate sales and university discards, the result isn’t just fewer books on shelves — it’s fewer books full stop. Libraries should have a right of first refusal on any book that’s being acquired for AI training purposes.

The Bottom Line

The AI industry has a data problem, and it’s solving it by making the problem invisible.

Shredding rare books doesn’t just erase physical objects. It erases the ability of future readers, researchers, and competing AI builders to access the same knowledge. The books that go into the shredder today won’t be available for the next generation of models — unless those models are built by the same companies that destroyed the originals.

We’re creating a world where the past is owned by whoever could afford to digitize and destroy it.

That’s not progress. That’s a private flame for a public library.

The next time an AI company announces a breakthrough model and credits its “high-quality proprietary training data,” ask yourself: what books died to make that possible? And will anyone be able to read them again?

References

1. Hacker News — “AI companies are shredding rare books” (discussion thread, 794 points / 514 comments)
2. Tom’s Hardware — “AI companies are reportedly shredding millions of books to train models”
3. Epoch AI — research on training data exhaustion and AI scaling
4. Internet Archive — Open Library and the controlled digital lending case
5. Common Corpus — open licensed corpus for AI training
6. EleutherAI — The Pile, an open-source training dataset

The post AI Companies Are Shredding Rare Books — And That Changes Everything About Training Data appeared first on The AI Prism.

For the last three years, the generative AI industry has been playing a massive game of legal chicken. Companies scraped billions of images, articles, and lines of code to train their models, operating under the assumption that it fell under “fair use.” Meanwhile, creators and publishers kept firing off lawsuits, waiting for a judge to finally draw a line in the sand.

In the summer of 2026, the line was drawn. And if you are a business using AI to generate marketing materials, code, or commercial art, you need to pay very close attention to generative AI legal issues right now.

Here at The AI Prism, we don’t do legalese. We’re going to break down exactly what the recent landmark court decisions mean for you, why the “wild west” era of AI is officially over, and how to keep your company out of the crosshairs.

The “Copyright Cliff” Explained

Over the last eight weeks, a series of appellate court rulings have effectively created what legal experts are calling the “Copyright Cliff.”

The core issue was never really about whether a human can type a prompt and own the resulting image. The courts actually settled that early on: purely AI-generated works cannot be copyrighted because they lack human authorship.

No, the recent cliffhanger was about the input. Specifically, whether tech companies could legally use copyrighted material to train their commercial models without licensing it.

The 2026 ruling came down hard: Commercial AI models trained on copyrighted works without explicit licensing agreements are infringing on the original creators’ rights. The “fair use” defense was thoroughly rejected for commercial applications.

The Court Cases That Changed Everything

To understand where we are, it helps to look at the three cases that created the Copyright Cliff. The first and most consequential is The New York Times Company v. OpenAI, Inc., which reached the Second Circuit Court of Appeals in April 2026. The NYT’s argument was straightforward: OpenAI ingested millions of copyrighted articles to train its models, then built a commercial product that could reproduce those articles verbatim or generate summaries that competed directly with the original content. The court sided decisively with the NYT, ruling that commercial training on copyrighted material without a license constitutes “massive copyright infringement” that cannot be shielded by fair use. The case has been remanded for damages determination, and estimates range from $15 billion to $65 billion in potential liability.

The second pivotal ruling came in Andersen v. Stability AI, which consolidated cases from visual artists against multiple AI image generators. The Ninth Circuit ruled in May 2026 that while individual training images may not be directly infringing, the ability of these models to reproduce copyrighted works in “substantially similar” form on demand creates derivative liability. The court established a “market substitution test”: if a prompt can reliably generate images in a specific artist’s style, and a consumer uses that instead of commissioning the artist, the model has become a market substitute for the original work. This was a devastating blow to the “transformative use” defense that AI companies had relied on.

The third case, Getty Images v. Stability AI in the UK, actually set a precedent before the US rulings. The UK High Court ruled in February 2026 that AI training on copyrighted images without a license violates UK copyright law, establishing a global benchmark. The ruling was notable for its pragmatic remedy: rather than ordering the destruction of the model (which legal scholars argued would be impractical and disproportionate), the court ordered a compulsory licensing scheme with ongoing royalty payments tied to model revenue. This hybrid approach — finding infringement but crafting a remedy that doesn’t destroy the technology — has been widely praised as a model for balanced AI copyright regulation.

The Earthquake in Silicon Valley

This ruling sent immediate shockwaves through the tech industry.

The big AI labs are currently scrambling. We are seeing the immediate rollout of “provenance filters”—tools built into platforms that can mathematically prove a model was trained exclusively on public domain, licensed, or synthetically generated data.

But the bigger problem is the models already out in the wild. If your company has been using a model trained on unlicensed data to generate commercial assets, are you liable?

Here is the good news: The courts have generally shielded end-users from the training liability, placing that burden on the AI providers. If you used a popular AI tool to write a blog post in 2024, the original author isn’t going to sue you for copyright infringement.

But that brings us to the bad news.

The Licensing Framework Revolution

In response to the rulings, the industry has been racing to build licensing infrastructure that didn’t exist before. The most significant development is the “Content Registry” system being deployed by the Copyright Office in partnership with major platforms. Starting in August 2026, AI training companies must register their training datasets with the Content Registry, which cross-references each work against a database of rights-holder information. If a copyrighted work is identified in a registered training set without a matching license, the system automatically generates a licensing demand and, if unresolved, escalates to the Copyright Office for enforcement.

On the private side, companies like Shutterstock and Adobe have turned their existing licensing marketplaces into something far more ambitious. The “Shutterstock AI Training License,” launched in January 2026, allows any contributor to opt their entire portfolio into AI training for a per-image fee based on model revenue. Within six months, over 1.2 million contributors have enrolled, and Shutterstock has licensed its catalog to three of the five major AI labs. Adobe’s equivalent program, integrated into the Adobe Stock platform, has been even more successful, with over 85% of contributing artists opting in — likely because Adobe made the opt-in the default and tied it to generative AI tools that creators are already using.

Getty Images has taken a different approach, launching “Verify & License” — a tool that allows any creator to check whether their work appears in a major AI training dataset and, if so, automatically negotiate a license. The tool has processed over 500,000 claims in its first three months, with an average payout of $0.003 per training image per model version. While that number sounds vanishingly small, the scale is enormous: a photographer whose 10,000 images were used across four major model versions stands to receive approximately $120,000 in cumulative licensing fees.

Can You Protect Your AI-Assisted Work?

This is where 99% of businesses are getting tripped up with AI copyright laws in 2026.

Let’s say you use an AI tool to generate the first draft of a white paper, and then your human editor heavily revises it. Can you copyright that final white paper?

The current legal standard requires “substantial human transformation.” A few prompt tweaks and light copyediting are no longer enough. If the core structure, ideas, and phrasing originated from the AI, the courts are viewing it as uncopyrightable material.

This is a massive problem for brands. If you generate an AI mascot for your marketing campaign, you don’t own it. Which means a competitor can legally take that exact same mascot and use it for their own campaign, and you have no legal recourse.

The International Dimension: A Fragmented Global Landscape

One of the most challenging aspects of the new AI copyright regime is its fragmentation across jurisdictions. The United States, the European Union, China, and the United Kingdom have all arrived at meaningfully different legal frameworks, creating a compliance nightmare for any company operating internationally.

The European Union’s approach, codified in the AI Act’s copyright provisions that took full effect in March 2026, is the most creator-friendly. The EU requires that all AI training data be documented in a machine-readable format and that rights-holders can opt out of training for any purpose — including research. The “opt-out” mechanism is enforced through the “ROD” (Rights Objections Database), a centralized registry maintained by the EU Intellectual Property Office where creators can register their works. AI companies are legally required to check the ROD before every training run, and failure to do so carries penalties of up to 6% of global revenue.

China has taken the opposite approach, enshrining a broad “innovation exception” in its 2025 AI regulations. Chinese law permits AI training on any publicly available data, including copyrighted works, as long as the training does not “substantially impair” the original work’s market value. The standard is vague, but in practice, it has created permissive environment where Chinese AI companies have accelerated their model development while their Western counterparts navigate the new licensing landscape. This asymmetry is creating genuine concern among Western policymakers about competitive disadvantage, and there are already calls for a “level playing field” provision in future legislation.

Your 2026 AI Compliance Checklist

So, how do you keep your business productive without stepping on a legal landmine? You need to pivot your AI strategy from “generation” to “augmentation.”

Here is a quick compliance checklist to keep your legal team happy:

1. Demand Provenance for Commercial Use. Stop using open-source or unverified models for anything that goes on your website, in your ads, or in your products. Only use AI platforms that provide a “License Clean” certification, guaranteeing their training data is fully licensed.

2. The 80/20 Rule of Human Authorship. If you are creating something you need to own the copyright to (like a logo, a core software feature, or a flagship piece of content), AI should make up no more than 20% of the final work. Use AI to brainstorm, outline, or overcome writer’s block. But the heavy lifting of creation must be done by a human.

3. Update Your Terms of Service. If your platform allows users to upload or generate content using AI, you need to update your TOS immediately. Make it clear that users are responsible for ensuring the AI-generated content they bring onto your platform doesn’t infringe on third-party rights.

4. Audit Your Historical Assets. Don’t wait for a cease-and-desist letter. Do an audit of your digital assets from 2023–2025. If you have heavily AI-generated content currently being used in commercial ways, start budgeting to replace it with human-created or properly licensed alternatives.

5. Monitor International Obligations. If you operate in the EU, ensure your AI tools comply with the ROD opt-out database requirements. If you’re sourcing AI services from China, verify that the output does not infringe on US or EU copyright standards, even if it complies with Chinese law.

The Silver Lining for Creators

While businesses are scrambling to adapt, there is a massive silver lining here for human creators.

The Copyright Cliff has inadvertently created a premium market for human-made art and writing. As the internet gets flooded with uncopyrightable, generic AI slop, companies are realizing that if they want to own their intellectual property, they have to hire humans.

We are seeing a boom in freelance writers, illustrators, and composers who are explicitly marketing “100% Human-Made, Copyright-Protected” work.

The Bottom Line

The days of throwing caution to the wind and generating whatever you want with AI are over. The courts have spoken, and the era of AI copyright laws has officially matured.

Generative AI is no longer a legal gray area where you can ask for forgiveness rather than permission. It is a powerful tool that must be wielded with a clear understanding of intellectual property boundaries.

If your AI strategy doesn’t include a legal strategy, you’re doing it wrong.

Related Reading

• How AI learned to reason

Sources & Further Reading

• U.S. Copyright Office – AI Policy Guidance
• EU AI Act – Copyright Provisions
• Stanford AI Index – Legal Trends Report

The post The Copyright Cliff: What the Latest Rulings Mean for AI-Generated Content appeared first on The AI Prism.