The world of artificial intelligence is no stranger to controversy, and a recent discovery has sparked outrage among media publishers. OpenAI and Anthropic, two of the largest AI startups, have been found to be ignoring or circumventing the robots.txt rule, which prevents automated scraping of websites. This rule is in place to protect publishers’ content from being used without permission or compensation. Despite publicly stating that they respect this rule, both companies have been caught red-handed, scraping web content for free model training data. This is a clear violation of publishers’ rights and raises questions about the ethics of AI companies. As the AI industry continues to grow, it’s essential that companies prioritize transparency and respect for intellectual property. The fact that these companies are ignoring established web rules is a worrying sign of what’s to come if left unchecked.
AI Giants Disregard Web Rules
OpenAI and Anthropic have been found to be either ignoring or circumventing an established web rule, called robots.txt, that prevents automated scraping of websites.
1–2 minutes
TOP STORIES
Quantum computing is transforming industries, but it poses significant cybersecurity risks …
A coalition of state attorneys general has opened an investigation into OpenAI …
The U.S. government’s export control directive has forced Anthropic to disable its new AI models, raising questions about regulation and …
SpaceX’s recent deal with Google highlights its shift from aerospace to AI infrastructure …
Google is suing to dismantle the infrastructure behind an alleged massive AI-powered cybercrime operation …
AI usage continues to grow rapidly, even as public sentiment remains skeptical …
