Technology
The Indian Express

Meta deletes provision after experts flag ‘broad’ scraping permissions for AI training

Source Entity

The Indian Express

October 20, 2026
Meta deletes provision after experts flag ‘broad’ scraping permissions for AI training

Meta has removed controversial language from its commercial terms of service that appeared to grant the company broad rights to scrape news sites for AI training. While the company claims its crawling practices remain unchanged, the move follows significant backlash from legal experts and publishers.

Meta’s Policy U-Turn: Navigating the Ethics of AI Data Scraping

The Controversy Over Commercial Terms

In a move that highlights the ongoing tension between Big Tech and digital publishers, Meta recently faced intense scrutiny after updating its commercial terms of use. The original language in question explicitly stated that Meta could utilize content from domains, web pages, or URLs associated with its business accounts to “provide, develop, improve, research, train, and maintain the integrity” of its products. Legal experts, including those from the Nieman Lab, interpreted this as a sweeping provision that would effectively grant Meta the right to scrape proprietary content from news organizations and other publishers to train its artificial intelligence models.

Backlash and Public Response

The inclusion of this language sparked immediate backlash within the tech and media industries. Given the current climate of the AI race, where companies are under immense pressure to acquire high-quality training data, the provision was viewed by many as an overreach. Critics, such as Professor James Grimmelmann, signaled concerns that this policy could undermine the intellectual property rights of publishers who rely on their content for revenue. The swift removal of the provision on October 17 suggests that Meta recognized the reputational risk and legal vulnerability associated with such broad scraping permissions.

Meta’s Stance and Legal Context

Despite the removal of the contentious clause, a Meta spokesperson maintained that the update did not reflect any change in how the company crawls the web. This defense highlights a critical disconnect between how tech giants define their data collection practices and how publishers perceive them. While Meta successfully defended itself in a high-profile copyright lawsuit last year, the legal landscape remains volatile. Numerous other cases are currently proceeding through the courts, testing the boundaries of fair use and copyright law as applied to generative AI training.

Broader Implications for the Digital Ecosystem

This incident serves as a bellwether for the future of the open web. As AI models become more sophisticated, the demand for human-generated content to train these systems will only grow. If tech giants continue to pursue aggressive data acquisition policies without clear consent or compensation models, it could lead to further friction with the publishing industry. The situation underscores the need for a standardized framework that balances technological innovation with the protection of original journalism and digital assets.

Future Trends and Market Outlook

Looking ahead, we can expect increased regulatory oversight regarding how companies like Meta, Google, and OpenAI source their training data. Publishers are likely to become more proactive in implementing technical barriers, such as robust robots.txt files or paywalls, to protect their content from unauthorized scraping. Meta’s decision to backtrack indicates that even the largest tech entities are sensitive to public and expert pressure, suggesting that future AI development will be increasingly shaped by public accountability and ongoing legal battles over the ownership of the information that powers the modern internet.

Verification Required?

Read the full report from the primary source

Go to The Indian Express