- cross-posted to:
- hackernews@lemmy.bestiver.se
- cross-posted to:
- hackernews@lemmy.bestiver.se
A year of fighting scrapers on my 1.5 million-page website. What I tried, how I failed, and what’s working now.
A year of fighting scrapers on my 1.5 million-page website. What I tried, how I failed, and what’s working now.
I don’t run PatronView, just sharing the blog post from them.
I tried to access
angieguardian.org, but was met with “JavaScript is required to access this site” which basically guaranteed I will never visit it again.OK fine. That is due to the pow. The whole point of Angie Guardian. I also don’t like it. But the internet is fked up!