Back to list
Oct 18, 2026
674
0
0
IT NewsNEW

Meta Pulls Commercial Terms Clause on Scraping, AI Training

Meta removed a Commercial Terms sentence experts read as letting it scrape publisher sites for AI training. Meta says crawlers are unchanged.

#Meta#Commercial Terms#Web Scraping#AI Training#robots.txt
Meta Pulls Commercial Terms Clause on Scraping, AI Training
AI Summary

Meta removed a Commercial Terms sentence experts read as letting it scrape publisher sites for AI training. Meta says crawlers are unchanged.

Introduction

In October 2026, Meta updated its Commercial Terms for business accounts. A passage in the update said Meta may use content from domains, web pages and URLs associated with a business "to provide, develop, improve, research, train, and maintain the integrity of" Meta products. Legal experts told Nieman Lab it could be read as permission to scrape publisher sites and train AI on them. Meta said nothing changed about its crawlers, and on October 17 the language was removed. This article covers that sequence: what the clause said, how it was read, what Meta said, and what the removal does and does not settle.

What the Terms Said

Nieman Lab reported the update was set to take effect on October 30 and applies to business accounts that manage Facebook pages, Messenger, Instagram profiles or WhatsApp channels, which includes news publishers. According to the text quoted by Nieman Lab and The Verge, the terms authorized Meta "or any entity acting on our behalf" to use automated software, including scrapers, bots, crawlers and user agents, and to "create test credentials" to access, index, cache, analyze, collect, retrieve or crawl domains, web pages or URLs associated with a business's products or services, and to periodically pull updates. The following sentence said Meta may use content from those locations to "provide, develop, improve, research, train, and maintain the integrity of" Meta products, services and features.

How Experts Read It

Nieman Lab said three legal experts reviewed the terms at its request. Matt Topic, an attorney at Loevy & Loevy, called it "a remarkable provision to bury in [the] terms of service" and said that "it's not clear whether a court would enforce this, but publishers should assume that it would be enforceable." James Grimmelmann of Cornell Law School said that for news publishers this "clearly represents permission to Meta to train AI on any content from their sites." Both outlets reported the experts' concern that Meta could argue its commercial terms supersede blocking instructions such as robots.txt. Grimmelmann also said the "test credentials" wording would technically allow Meta to "sign up as a fake user" to get past registration walls. Nieman Lab reported that Meta declined to say whether the credentials would bypass paywalls.

Benjamin Sobel of the University of Wisconsin compared the structure to "tying" in antitrust law: to use Meta products that require the commercial terms, a business has to accept the crawling permissions too. Nieman Lab also reported that there was no way for business accounts to opt out before October 30, and that the terms said those who disagree should stop using Meta products for business or commercial purposes.

Meta's Response

Meta spokesperson Daniel Roberts initially said the company was consolidating commercial and self-serve ad terms, and that "there is no change to how Meta uses web crawlers; any suggestion to the contrary is false." Meta VP of communications Andy Stone wrote on X that the update was "designed to make sure we're able to pull accurate information about products for sale on third-party websites when making on-platform ad and content recommendations, not about scraping news sites" (as quoted by The Verge).

On October 17, The Verge reported Meta had updated its terms again so the "may use any content" sentence no longer appeared on the commercial terms page. Roberts' statement said: "We've heard you and want to clarify: the crawling terms we consolidated only applied to our ads and business products, and we've clarified that in the terms themselves. It does not change how Meta uses web crawlers. As always, content owners can use robots.txt to signal their preferences. This is not about scraping news sites, and these updates don't give us new rights that supersede those preferences."

DateEvent
Early October 2026Meta notifies users of the update via a blog post and Business Suite (per Nieman Lab)
October 16Nieman Lab publishes legal-expert analysis; The Verge adds Meta statements
October 17Meta removes the language; The Verge and TechCrunch report it
October 30Original effective date of the updated terms (per Nieman Lab)

Context

Nieman Lab noted that any AI training on content collected this way would still depend on unsettled legal questions about AI training and fair use, and pointed to ongoing federal cases between publishers and AI developers, including a class action filed in May by five large book publishers alleging Meta pirated millions of books to train Llama. TechCrunch noted that Meta defeated a high-profile copyright lawsuit last year while other cases against AI companies, including Meta, continue. The Verge noted Meta has struck AI licensing deals with CNN, Fox News, USA Today and People Inc., and Nieman Lab linked the terms to Meta One, a paid subscription that restricts external links for some accounts.

Analysis

The episode shows how contract language, not only crawler behavior, can carry AI-training implications. Robots.txt is a voluntary signal; a clause that lets a platform argue its terms override that signal changes what publishers rely on. Meta's position is that the clause was about ads and business products. The experts' position is that the text, as written, was broader. The removal resolves the immediate dispute without a ruling on either reading.

For publishers, the practical takeaways are to read commercial terms for crawling and training language when they change and to keep robots.txt directives and licensing terms aligned. For platforms, the lesson is that consolidating terms is not neutral when the combined text grants new breadth.

Conclusion

Meta removed the contested sentence the day after the expert reporting and restated that robots.txt preferences are respected. The cited coverage does not show the full revised terms, so publishers will want to read them directly before October 30. The story is a useful case study in how scraping rights get argued through terms of service.

Editor's Verdict

Meta Pulls Commercial Terms Clause on Scraping, AI Training is a short-lived dispute with lasting relevance for anyone whose site is tied to a Meta business account.

The strongest case for paying attention: a quick reversal after public scrutiny shows the terms could be revised in response to feedback. That alone raises the bar for what readers should expect in this space. Reinforcing that, a clear public statement from Meta that robots.txt preferences are respected gives publishers a quotable commitment — practical value rather than just headline appeal. The broader signal worth registering is straightforward: contract language, not only crawler behavior, can carry AI-training implications for publishers. On the other side of the ledger, one constraint is real rather than a marketing footnote: the removal addresses one sentence and does not by itself settle how the remaining crawl authorization should be read. It should factor into any serious decision. Layered on top of that, the company declined to answer Nieman Lab's questions on whether test credentials would bypass paywalls — which narrows the set of teams for whom this is an obvious yes.

For publishers, media lawyers, and teams managing Meta business accounts, the practical step is to read the revised Commercial Terms before the October 30 effective date and keep robots.txt directives current. For everyone else, this is a useful case study in how AI-training rights get argued through terms of service.

Advertisement

Pros

  • a quick reversal after public scrutiny shows the terms could be revised in response to feedback
  • a clear public statement from Meta that robots.txt preferences are respected gives publishers a quotable commitment
  • detailed expert commentary in the original reporting gave a concrete reading of the clause before it took effect

Cons

  • the removal addresses one sentence and does not by itself settle how the remaining crawl authorization should be read
  • the company declined to answer Nieman Lab's questions on whether test credentials would bypass paywalls
  • the dispute was resolved by statement rather than by a legal ruling on the earlier text
Advertisement

Comments0

Key Features

1. The clause: Meta 'may use any content from such domains, web pages, or URLs to provide, develop, improve, research, train, and maintain the integrity of' Meta products. 2. Expert reading: legal experts told Nieman Lab it could be read as permission to train AI on publisher content and to argue the terms supersede robots.txt. 3. Test credentials: the terms allowed Meta to create test credentials; Cornell's James Grimmelmann said this could mean signing up as a fake user to pass registration walls. 4. Meta's position: crawling terms only applied to ads and business products, with no change to how Meta uses web crawlers. 5. Reversal: the sentence was removed on October 17, 2026, ahead of the October 30 effective date.

Key Insights

  • contract language, not only crawler behavior, can carry AI-training implications for publishers
  • Meta said from the start that crawler behavior was unchanged, then removed the sentence after backlash
  • Legal experts' main concern was that Meta could argue its commercial terms override robots.txt, a voluntary signal
  • Nieman Lab reported no opt-out for business accounts before October 30; the terms said those who disagree should stop using Meta products for business purposes
  • Benjamin Sobel compared the structure to antitrust 'tying': accept the crawling permissions to use the business products
  • Any AI training on such content would still hinge on unsettled fair-use questions, according to the experts quoted by Nieman Lab
  • The removal ends the immediate dispute without a ruling on how the text should have been read

Was this review helpful?

Share

Twitter/X
Advertisement