Reddit CEO Steve Huffman is standing by Reddit’s decision to block companies from scraping the site without an AI agreement.

Last week, 404 Media noticed that search engines that weren’t Google were no longer listing recent Reddit posts in results. This was because Reddit updated its Robots Exclusion Protocol (txt file) to block bots from scraping the site. The file reads: “Reddit believes in an open Internet, but not the misuse of public content.” Since the news broke, OpenAI announced SearchGPT, which can show recent Reddit results.

The change came a year after Reddit began its efforts to stop free scraping, which Huffman initially framed as an attempt to stop AI companies from making money off of Reddit content for free. This endeavor also led Reddit to begin charging for API access (the high pricing led to many third-party Reddit apps closing).

In an interview with The Verge today, Huffman stood by the changes that led to Google temporarily being the only search engine able to show recent discussions from Reddit. Reddit and Google signed an AI training deal in February said to be worth $60 million a year. It’s unclear how much Reddit’s OpenAI deal is worth.

Huffman said:

Without these agreements, we don’t have any say or knowledge of how our data is displayed and what it’s used for, which has put us in a position now of blocking folks who haven’t been willing to come to terms with how we’d like our data to be used or not used.

“[It’s been] a real pain in the ass to block these companies,” Huffman told The Verge.

  • SteveFromMySpace@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    5
    arrow-down
    1
    ·
    2 months ago

    We all learned a long time ago to assume someone is serious until they indicate otherwise. If the joke is indistinguishable from a serious reaction then it’s a bad joke due to ambiguity.

      • SteveFromMySpace@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        5
        ·
        edit-2
        2 months ago

        Deadpan delivery on a strictly text medium has always been a difficult needle to thread. It only works in literature because the writer can describe how it was stated, which would look odd in forums/texts/emails/etc. he added sincerely

        • You’re not wrong there either, but I do recall a time in which (at least in threads/forums/chat) it worked fairly well.

          The issue is that the main way to detect it is to look for an opinion that was wildly diverged from the consensus, but… yeah, I guess people just broadcast those seriously now.

          Fuck.