ARTICLE AD BOX
Advertisement
Reddit blocks large hunt engines from caller content, but Google, sparking statement connected information entree and AI grooming practices.
- Reddit blocks astir hunt engines from caller content.
- Google retains entree owed to a $60 cardinal deal.
- This determination aligns with broader trends successful contented monetization and AI grooming information protection.
![](https://www.searchenginejournal.com/wp-content/uploads/2024/07/img_2024-07-26-150340-445.jpeg)
Reddit has precocious tightened its grip connected who tin entree its content, blocking large hunt engines from indexing caller posts and comments.
This determination has sparked discussions successful the SEO and integer selling communities astir the aboriginal of contented accessibility and AI grooming data.
What’s Happening?
First reported by 404 Media, Reddit updated its robots.txt file, preventing astir web crawlers from accessing its latest content.
Google, however, remains an exception, apt owed to a $60 cardinal deal that allows the hunt elephantine to usage Reddit’s contented for AI training.
Brent Csutoras, laminitis of Search Engine Journal, offers immoderate context:
“Since taking connected caller investors and starting their pathway to IPO, Reddit has moved distant from being open-source and allowing anyone to scrape their contented and usage their APIs without paying.”
The Google Exception
Currently, Google is the lone large hunt motor capable to show caller Reddit results erstwhile users hunt with “site:reddit.com.”
This exclusive entree sets Google isolated from competitors similar Bing and DuckDuckGo.
Why This Matters
For users who trust connected appending “Reddit” to their searches to find human-generated answers, this alteration means they’ll beryllium constricted to utilizing Google oregon hunt engines that propulsion from Google’s index.
It presents caller challenges for SEO professionals and marketers successful monitoring and analyzing discussions connected 1 of the internet’s largest platforms.
The Bigger Picture
Reddit’s determination aligns with a broader inclination of contented creators and platforms seeking compensation for utilizing their information successful AI training.
As Csutoras points out:
“Publications, artists, and entertainers person been suing OpenAI and different AI companies, blocking AI companies, and warring to debar utilizing nationalist contented for AI training.”
What’s Next?
While this improvement whitethorn look surprising, Csutoras suggests it’s a logical measurement for Reddit.
He notes:
“It seems astute connected Reddit’s part, particularly since akin moves successful the past person allowed them to IPO and spot beardown maturation for their valuation implicit the past 2 years.”
FAQ
What is the caller alteration Reddit has made regarding contented accessibility?
Reddit has updated its robots.txt record to artifact large hunt engines from indexing its latest posts and comments. This alteration exempts Google owed to a $60 cardinal deal, allowing Google to usage Reddit’s contented for AI grooming purposes.
Why does Google person exclusive entree to Reddit’s latest content?
Google has exclusive entree to Reddit’s latest contented due to the fact that of a $60 cardinal woody that allows Google to usage Reddit’s contented for AI training. This statement sets Google isolated from different hunt engines similar Bing and DuckDuckGo, which are incapable to scale caller Reddit posts and comments.
What broader inclination does Reddit’s caller determination reflect?
Reddit’s determination to bounds hunt motor entree aligns with a larger inclination wherever contented creators and platforms question compensation for the usage of their information successful AI training. Many publications, artists, and entertainers are taking akin actions to either artifact oregon request compensation from AI companies utilizing their content.
Featured Image: Mamun sheikh K/Shutterstock
SEJ STAFF Matt G. Southern Senior News Writer astatine Search Engine Journal
Matt G. Southern, Senior News Writer, has been with Search Engine Journal since 2013. With a bachelor’s grade successful communications, ...
Subscribe To Our Newsletter.
Conquer your time with regular hunt selling news.