Wikipedia Urges AI Companies to Stop Scraping and Use Paid API to Support Its Mission

Wikipedia is taking a clear stance on how artificial intelligence companies should access its vast repository of knowledge. In a blog post published Monday, the Wikimedia Foundation—the nonprofit that operates the world’s largest online encyclopedia—urged AI developers to use its paid Wikimedia Enterprise platform instead of scraping content from the site. The organization emphasized that responsible use and proper attribution are essential as AI increasingly relies on its articles.

The Wikimedia Enterprise platform is an opt-in, paid product designed for large-scale access. According to the blog post, this approach prevents excessive strain on Wikipedia’s servers while also allowing AI companies to financially support the nonprofit mission. “By accessing content responsibly, AI developers can help ensure Wikipedia continues to thrive in the digital age,” the foundation wrote.

Wikipedia has long faced challenges with automated bots scraping its content. The organization recently reported unusually high traffic in May and June, later traced to AI bots attempting to bypass detection systems. At the same time, human page views declined by 8% year-over-year, underscoring the importance of sustainable, properly credited access to its knowledge base.

The foundation’s guidelines for AI developers stress proper attribution, ensuring credit is given to the millions of volunteers who contribute content. “For people to trust information shared on the internet, platforms should make it clear where the information is sourced from and elevate opportunities to visit and participate in those sources,” the post states. Without such practices, Wikipedia warns that fewer volunteer editors and donors may support its work.

Earlier this year, Wikipedia unveiled an AI strategy aimed at helping its editors rather than replacing them. The plan includes AI-assisted workflows to automate tedious tasks, translation tools, and other enhancements to improve content quality. By promoting responsible AI integration, Wikipedia hopes to maintain both the integrity of its information and the sustainability of its community-driven model.

source: techcrunch