Yes, specially how they restricted their API in recent times. Best time for all that would’ve been a few years back when reddit still cared about something else than money and you could easily access everything. Don’t think the new reddit site is even scrappable at all
Well, google’s AI already scraped all of reddit, so scrape google’s AI in return. Not necessarily as easy to do with an AI though but it seems people are trying if Anthropic and OpenAI are complaining about it happening.
Yeah, I know that one. But I meant archive as a copy of the content that can remain available even after reddit blocks free access without an account
I don’t think so. The API is limited, so huge amounts of data would be expensive to crawl these days, no?
Yes, specially how they restricted their API in recent times. Best time for all that would’ve been a few years back when reddit still cared about something else than money and you could easily access everything. Don’t think the new reddit site is even scrappable at all
Well, google’s AI already scraped all of reddit, so scrape google’s AI in return. Not necessarily as easy to do with an AI though but it seems people are trying if Anthropic and OpenAI are complaining about it happening.