• IphtashuFitz@lemmy.world
    link
    fedilink
    English
    arrow-up
    3
    ·
    4 months ago

    Asking for a friend…

    What would it take to create a domain that just acts as a proxy to Reddit but serves up its own robots.txt that allows all bots?

    • Wilzax@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      4 months ago

      Probably a LOT of proxy IPs to act as different “Users” so you can overcome the rate limit that I expect they would be using to enforce such a deal