Reddit is proscribing its availability to the Web Archive’s Wayback Machine

The Web Archive’s Wayback Machine is the newest sufferer of Reddit’s crackdown on knowledge entry. The corporate has begun to position new restrictions on what the archive web site will be capable to entry in a transfer that may considerably restrict the Wayback Machine’s skill to protect data from Reddit.

With the change, the Wayback Machine, a challenge run by the nonprofit Web Archive, will solely be capable to crawl Reddit’s homepage. It would now not be capable to entry feedback, subreddit pages, submit particulars, profiles and different knowledge.

The transfer is the newest step Reddit has taken on its quest to restrict AI corporations’ skill to make use of its knowledge to coach giant language fashions with out paying licensing fees. It is also a notably completely different stance than the corporate took final 12 months, when it explicitly mentioned that it will not restrict “good religion actors,” including the Web Archive. It is not clear what precisely has modified since then. Reddit appears to consider that AI corporations are circumventing its guidelines by scraping knowledge by way of the Wayback Machine. We have reached out to the Web Archive for remark.

Knowledge licensing has turn out to be a big enterprise for Reddit. The corporate has struck multimillion-dollar offers with OpenAI and Google that permit them to make use of Reddit posts to assist practice their AI fashions. On the identical time, Reddit has taken an more and more hardline stance towards corporations that try to make use of its knowledge with out such preparations. Earlier this 12 months, the corporate sued Anthropic, alleging it scraped Reddit for years with out permission.