Loading...
Market
Impact of Reddit's robots.txt update on web traffic by mid-2025?
2
Resolution / Starting Odds
Traffic increases • 33%
Traffic decreases • 33%
Traffic remains stable • 34%
Web traffic analytics reports from platforms like SimilarWeb or Google Analytics
Story
Reddit ($RDDT) Updates Robots.txt to Safeguard Against AI Crawlers
Jun 25, 2024, 07:14 PM
Reddit has announced upcoming changes to its platform aimed at safeguarding against AI crawlers. The company plans to update its robots.txt file to clearly specify that companies using automated agents to access Reddit must adhere to its terms. This move is part of Reddit's broader strategy to block and rate-limit unknown bots and crawlers. Additionally, Reddit will continue to allow good faith actors, such as researchers and organizations like the Internet Archive, to access its content for non-commercial use. These measures come as companies like Google and OpenAI increasingly license Reddit data to train large language models, which has led to concerns about the quality and authenticity of the content being used. The announcement was highlighted by TechCrunch and Reddit's stock symbol is $RDDT.
View original story
Similar markets
Mojeek sees a decline in traffic • 25%
Bing sees a decline in traffic • 25%
DuckDuckGo sees a decline in traffic • 25%
No significant impact on any search engine • 25%
Google's market share increases • 25%
Google's market share decreases • 25%
Bing's market share increases • 25%
DuckDuckGo's market share increases • 25%
Yes • 50%
No • 50%
Twitter restricts search engines • 25%
Facebook restricts search engines • 25%
LinkedIn restricts search engines • 25%
No other major websites follow suit • 25%
Yes • 50%
No • 50%
Increase by more than 10% • 25%
Increase by less than 10% • 25%
Decrease by less than 10% • 25%
Decrease by more than 10% • 25%
Yes • 50%
No • 50%
Less than 10% • 25%
10-20% • 25%
20-30% • 25%
More than 30% • 25%