Here’s the logic:
wget --mirror --convert-links --adjust-extension --page-requisites --no-parent https://example.com/

  • Fifrok@discuss.tchncs.de
    link
    fedilink
    arrow-up
    6
    ·
    edit-2
    7 hours ago

    Hey, just so you know this is legally iffy.

    PieFed.social is hosted in the EU, and this amount of scraping can fall under the Copyright Directive 2001/29/EC and the Database Directive 96/9/EC.

    Even if the content is public, EU law can restrict bulk extraction and republication. Especially if you’re mirroring a substantial part of the site or making it available through your own frontend.

    Might be worth reconsidering what you’re pulling and how you’re using it, or atleast making sure it’s legal.

    edit: I’m obviously not a lawer, this might have no problems related to that, but I would make sure if I were you.