Image Not FoundImage Not Found

A person at a desk looks at website analytics on a laptop with a printed terms document beside the keyboard.

Meta removes AI-training language from Commercial Terms, but the crawl-rights fight isn’t over

Meta has edited a controversial preview of its Commercial Terms ahead of an October 30, 2026 rollout, removing language that critics said could be read as permission to crawl websites tied to business accounts and use that material to help train Meta products. As The Verge reported, the disputed training reference is gone. Meta says the change is a clarification, not a policy shift: the terms, it says, apply to ads and business products, do not create new rights to scrape news sites, and do not change how its crawlers operate.

That narrows the immediate flashpoint. It does not settle the more important question for publishers, merchants, agencies, and software firms: did the rewrite materially protect them from unwanted AI use of their websites, or did it mainly soften one sentence while leaving broad crawl permission and a lot of practical ambiguity in place?

What changed — and what did not

The key document is Meta’s own Commercial Terms preview. In the earlier version, Meta or an agent acting for it appeared to be authorized to use “scrapers, bots, spiders, crawlers, user agents, and test credentials” to access, index, cache, analyze, collect, retrieve, or crawl domains, pages, or URLs associated with a business’s products or services, and to pull updates periodically. The clause then listed broad purposes including providing, developing, improving, researching, training, and maintaining the integrity of Meta products.

The politically and commercially explosive part was not crawling by itself. Plenty of internet businesses crawl for search, previews, ad verification, safety, or product functionality. The problem was the combination of three things in one place: broad automated access, a wide definition of what could be reached, and an equally wide set of uses that included training.

Meta’s revision matters because it removes the clearest textual hook for readers who feared a contract-based route into AI training on business-linked websites. That is a real concession, or at least a real retreat in drafting. But the edit is not the same as a clean statement that such content is excluded from all AI-related uses everywhere, or that the company’s data pipelines have changed. Meta has not published a customer-facing map showing which crawler does what, which content each one can access, how robots.txt is honored by each system, how long data is kept, or what opt-out path exists for a business customer.

So the paper trail improved. The control surface is still incomplete.

The real fight is over contract, access, and use

This story makes more sense if you separate three layers that often get blurred together.

First is contract: what a business may be granting when it accepts platform terms or supplemental terms. Second is access: whether a crawler is actually able to reach a site, given robots.txt preferences, authentication, CDN rules, and anti-bot systems. Third is use: what happens to any material that is accessed, whether for ad operations, search, product improvement, research, or model development.

Meta’s public response mainly addresses the first layer. It says the terms are limited to advertising and business products and do not create new rights to scrape news sites. That could be true and still leave open hard questions inside the other two layers. A company can say a clause is about business tooling while still relying on broad words like “improve” or “research” elsewhere. It can say robots.txt preferences remain available while leaving unanswered which crawlers identify themselves clearly, which products depend on those fetches, and whether refusing one form of automated access affects another service.

That is why robots.txt should not be mistaken for a complete answer. It is a policy signal, not a security control and not, by itself, a full statement of contractual rights. If a site owner wants stronger practical control, it usually needs to pair robots.txt with authentication, rate limits, anti-bot enforcement, licensing terms, and log review. For large publishers, that is standard operating procedure. For many small businesses that linked a website to a Meta business account, it may not be.

The economic tension is obvious. A free or low-cost platform relationship can end up carrying permissions that a publisher or merchant would have priced very differently in a direct data license. That does not prove misuse. It does explain why a sentence about “training” triggered alarm far beyond the news industry.

Why publishers and businesses should not treat this as over

There is a temptation to read the rewrite as either a scandal defused or a smoking gun confirmed. Neither fits the public record.

On one side, the revision is meaningful. The most alarming wording was removed after criticism, and the reporting by The Verge and TechCrunch points to a visible change in the preview text. On the other side, there is still no public proof that Meta scraped any particular news site or trained on any particular business website because of this clause. The record today is about contract language and corporate explanation, not a regulator’s findings or a technical demonstration of a specific scrape-and-train pipeline.

What keeps the issue alive is the breadth of the remaining access language and the fuzziness around terms such as “associated” domains and “business products.” If a business links a storefront, help center, blog, or product documentation to an ad account, are all of those in scope? If a crawler accesses that material to “improve” a product, where exactly is the line between improvement and model development? The current public documents do not answer those questions cleanly.

There is also a broader industry backdrop. In an October 2026 study of 261 readable major websites, 91 sites — 35% of the sample — blocked at least one AI training crawler, while 56 sites, or 21%, blocked at least one AI search crawler. News publishers blocked far more than B2B SaaS sites. That does not tell us anything definitive about Meta’s internal behavior, but it does show that website owners increasingly see crawler-specific controls as a business decision, not a purely technical one.

For publishers, the tradeoff is especially awkward: blocking crawlers may reduce future training exposure, but aggressive restrictions can also complicate search visibility or user-directed fetches, depending on how a platform separates those functions. For ecommerce companies and software firms, the issue is less about headlines than about leverage. If a platform can tie product functionality to broad crawl permissions, the negotiation starts to look less like traffic exchange and more like data licensing without a clear price.

What businesses should verify before October 30

The most useful response is not outrage or reassurance. It is an audit.

Start with the documents: save the exact terms presented to your account, including regional variants and any supplemental terms. Then inventory the web properties connected to your Meta business presence — storefronts, blogs, help centers, docs, campaign landing pages, and feeds — and review their robots.txt files, authentication gates, anti-bot settings, CDN rules, and site-level licensing terms. Finally, check server and CDN logs for crawler identities and ask Meta direct operational questions: which crawlers may access which linked content, for what purpose, for how long, with what retention limits, and with what opt-out or dispute path.

That will not answer every unresolved question. It will, however, move the conversation from one edited sentence to the controls that actually shape who can fetch what, under which terms, and for whose benefit.