szmer
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
moe90@feddit.nl to Technology@lemmy.mlEnglish · 1 年前

Reddit is now blocking major search engines and AI bots — except the ones that pay

www.theverge.com

external-link
message-square
47
fedilink
  • cross-posted to:
  • informatica@feddit.it
359
external-link

Reddit is now blocking major search engines and AI bots — except the ones that pay

www.theverge.com

moe90@feddit.nl to Technology@lemmy.mlEnglish · 1 年前
message-square
47
fedilink
  • cross-posted to:
  • informatica@feddit.it
Sorry, Bing users.
alert-triangle
You must log in or # to comment.
  • IndescribablySad@threads.net@sh.itjust.works
    link
    fedilink
    arrow-up
    107
    arrow-down
    2
    ·
    1 年前

    Tangentially related- I fucking hate discord

    • PythagreousTitties@lemm.ee
      link
      fedilink
      English
      arrow-up
      72
      arrow-down
      3
      ·
      1 年前

      Discord is fine for chatting, voice, and iterating quickly on projects. I have no idea why people want to think it’s a forum. That’s ridiculous.

      • delirious_owl@discuss.online
        link
        fedilink
        arrow-up
        24
        arrow-down
        3
        ·
        edit-2
        1 年前

        Its pretty awful for all those things if you care about privacy or can’t signup for an account

        • ☂️-@lemmy.ml
          link
          fedilink
          arrow-up
          7
          arrow-down
          1
          ·
          edit-2
          2 个月前

          deleted by creator

        • Omniraptor@lemm.ee
          link
          fedilink
          arrow-up
          2
          ·
          edit-2
          1 年前

          Iirc strictly speaking you don’t need an account to use it, but most servers disable that option for anti spam reasons. But if you’re setting up a server for friends they can chat from a browser without having to sign up first

          • delirious_owl@discuss.online
            link
            fedilink
            arrow-up
            1
            ·
            1 年前

            Discord is self-hosted?

            • Omniraptor@lemm.ee
              link
              fedilink
              arrow-up
              2
              ·
              edit-2
              1 年前

              No, but discord chats are usually called “servers”

        • PythagreousTitties@lemm.ee
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          2
          ·
          1 年前

          Obviously you would need an account to use it.

      • Lenny@lemmy.world
        link
        fedilink
        arrow-up
        11
        arrow-down
        1
        ·
        1 年前

        We use it for our friend group, as we have pub nights, group meals, vacations etc. we also all do each other’s cat care when we’re out of town, so we have a channel devoted to pet photos etc. works well enough for us.

        • PythagreousTitties@lemm.ee
          link
          fedilink
          English
          arrow-up
          3
          ·
          1 年前

          Exactly. That’s a great use for it.

      • BleatingZombie@lemmy.world
        link
        fedilink
        arrow-up
        8
        arrow-down
        8
        ·
        edit-2
        1 年前

        Unpopular opinion: I never liked discord for chatting either. I found it strangely confusing trying to keep track of logins for each group

        Edit: I am indeed thinking of slack

        • PythagreousTitties@lemm.ee
          link
          fedilink
          English
          arrow-up
          16
          arrow-down
          1
          ·
          1 年前

          ? Discord has one log in.

        • dev_null@lemmy.ml
          link
          fedilink
          arrow-up
          7
          ·
          1 年前

          You may be thinking of Slack

    • MalReynolds@slrpnk.net
      link
      fedilink
      English
      arrow-up
      19
      arrow-down
      2
      ·
      1 年前

      I fucking hate discord

      It’s Cancer, have an upvote.

  • ohwhatfollyisman@lemmy.world
    link
    fedilink
    arrow-up
    57
    ·
    1 年前

    thanks to them for making my deredditification that much easier!

  • Scrubbles@poptalk.scrubbles.tech
    link
    fedilink
    English
    arrow-up
    50
    ·
    1 年前

    The only way they get my clicks now are when I Google something and they come up.

    They really keep making sure that I don’t end up there.

    • Pup Biru@aussie.zone
      link
      fedilink
      English
      arrow-up
      18
      ·
      1 年前

      libredirect helps with that on desktop

      (browser extension that turns links to sites like reddit, youtube, etc into links to redlib, invidious)

  • blackris@discuss.tchncs.de
    link
    fedilink
    arrow-up
    25
    ·
    1 年前

    Too bad. Hey, crazy idea: let’s create an open alternative for reddit with good content! Maybe something in the fediverse or so.

    • _g_be@lemmy.world
      link
      fedilink
      arrow-up
      11
      ·
      1 年前

      I think you’re onto something

    • Swedneck@discuss.tchncs.de
      link
      fedilink
      arrow-up
      5
      ·
      1 年前

      that would never work

  • GnuLinuxDude@lemmy.ml
    link
    fedilink
    arrow-up
    24
    ·
    1 年前

    There are numerous occasions where someone has a lingering question on Reddit that I see and know the answer to. It’s too bad it’s on Reddit because I no longer contribute to that website, and refuse to.

    • Ragnarok314159@sopuli.xyz
      link
      fedilink
      arrow-up
      6
      ·
      1 年前

      All the decent answers I find are from 5+ years ago. I check the user’s activity and they normally quit the place. Warms the heart.

  • moe90@feddit.nlOP
    link
    fedilink
    English
    arrow-up
    21
    arrow-down
    2
    ·
    1 年前

    just begin with site:reddit.com test for ddg and it still works

    • KevonLooney@lemm.ee
      link
      fedilink
      arrow-up
      23
      ·
      1 年前

      Are they new posts or old ones? They are blocking new ones, not old ones.

      • Pup Biru@aussie.zone
        link
        fedilink
        English
        arrow-up
        18
        ·
        1 年前

        new posts do not work

        this post in /r/selfhosted is from 8hr ago: SWEKIT v0.1 - an open source library to build software engineering agents (DEVIN) in a agentic framework agnostic manner!

        reddit/redlib: https://redlib.kylrth.com/r/selfhosted/comments/1eb86lf/swekit_v01_an_open_source_library_to_build/

        doesn’t appear in DDG results: https://duckduckgo.com/?q=site%3Areddit.com+SWEKIT+v0.1+-+an+open+source+library+to+build+software+engineering+agents+(DEVIN)+in+a+agentic+framework+agnostic+manner!&t=ffit

      • moe90@feddit.nlOP
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        14
        ·
        1 年前

        I tested and it got lots of reddit queries from even 2 years ago afaik.

        • KevonLooney@lemm.ee
          link
          fedilink
          arrow-up
          30
          ·
          1 年前

          They are blocking new ones, not old ones.

          • moe90@feddit.nlOP
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            16
            ·
            1 年前

            I even have diverse reddit queries from last week and even 2 years ago. this workaround is still ok tbh

            • ReversalHatchery@beehaw.org
              link
              fedilink
              English
              arrow-up
              14
              ·
              1 年前

              New means from yesterday, not from last week

    • acosmichippo@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      1 年前

      Based on my testing if you filter results by the last week or last day you get nothing. Past month works.

    • Mereo@lemmy.ca
      link
      fedilink
      arrow-up
      3
      ·
      1 年前

      For old posts. I can’t find new posts on DDG. I find them on Google but not on DDG.

      • moe90@feddit.nlOP
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        6
        ·
        1 年前

        I tried brave search begin with site:reddit.com test and it still works

  • fsxylo@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    17
    ·
    1 年前

    LMAO searching “____ reddit” is the only time I visit their site.

    They just really have no clue.

  • brucethemoose@lemmy.world
    link
    fedilink
    arrow-up
    13
    ·
    edit-2
    1 年前

    Would lemmy instances do this?

    I know they can’t afford to now, but hypothetically? A lot of people here don’t seem to like data scraping for AI.

    • Dave@lemmy.nz
      link
      fedilink
      arrow-up
      17
      ·
      edit-2
      1 年前

      You don’t need to scrape. If you want to get all the content on Lemmy, just set up an instance and subscribe to all the top communities, and the instances will just send you all the content.

      So there isn’t really a way to monetise or block it. I guess you could only federate to a whitelist, but the biggest instances will federate by default with any new instances until they are given a reason to defederate.

    • cmnybo@discuss.tchncs.de
      link
      fedilink
      English
      arrow-up
      9
      ·
      1 年前

      Some Lemmy instances disallow indexing in robots.txt, however indexers can choose to ignore that and actually blocking them takes a lot more effort.

      • brucethemoose@lemmy.world
        link
        fedilink
        arrow-up
        8
        ·
        1 年前

        Some places on a “budget” like Ao3 just rate limit hard.

        I don’t like that solution at all though.

  • tabular@lemmy.world
    link
    fedilink
    English
    arrow-up
    11
    ·
    1 年前

    The users who wrote the content are going to get a share of the money, right Reddit? Riiight? /s

  • Unchanged3656@infosec.pub
    link
    fedilink
    arrow-up
    8
    arrow-down
    1
    ·
    1 年前

    Brave search got an option for that.

    • moe90@feddit.nlOP
      link
      fedilink
      English
      arrow-up
      3
      ·
      1 年前

      begin with site:reddit.com test is much more accurate to get reddit search on brave search tbh

    • 2001zhaozhao@sh.itjust.works
      link
      fedilink
      arrow-up
      2
      ·
      edit-2
      1 年前

      Someone should make this feature but for ALL public web content you browse. Just download an extension to share the content of pages you browse to everyone (with cross-checking for accuracy), and you can view a fair share of what others have shared based on how much you contributed to the platform yourself. Basically crowd-sourced, unblockable web scraping.

    • ReversalHatchery@beehaw.org
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 年前

      We need that for DDG. Opt-in, of course, but with a banner that makes it clear why is that really needed

  • Happywop@lemmy.world
    link
    fedilink
    arrow-up
    7
    ·
    1 年前

    So glad I found this alternative. reddit, mods are psychos and the average user not much better

    • hlmeless@lemy.lol
      link
      fedilink
      English
      arrow-up
      2
      arrow-down
      1
      ·
      edit-2
      1 年前

      deleted by creator

  • badbytes@lemmy.world
    link
    fedilink
    arrow-up
    6
    arrow-down
    4
    ·
    1 年前

    Good, their answers are generally crap, and I wish they wouldn’t show in searches anyway.

    • lud@lemm.ee
      link
      fedilink
      arrow-up
      7
      ·
      edit-2
      19 天前

      deleted by creator

      • GoogleSellsAds@sh.itjust.works
        link
        fedilink
        arrow-up
        1
        ·
        1 年前

        I mean, you’re right if by humans you mean kids.

        Depending on the subject, I encounter more and more threads with <deleted by user> content. And billions and billions and billions of results that are either spam or written by unprofessionals.

        The smart crowd is not there anymore. The smart crowd that once was there, has removed the content that Reddit was worth visiting for. Let the Googzz have them and sell ads to each other.

        • lud@lemm.ee
          link
          fedilink
          arrow-up
          1
          ·
          edit-2
          19 天前

          deleted by creator

          • GoogleSellsAds@sh.itjust.works
            link
            fedilink
            arrow-up
            1
            ·
            1 年前

            Reddit was already invaded by bots before the API. I’d say it was most obvious right before the time Trump was elected.

            Sounds like you’re too smart to be on Lemmy. Sorry I offended you by spelling the name of your favorite ad company wrong.

            • lud@lemm.ee
              link
              fedilink
              arrow-up
              1
              ·
              edit-2
              19 天前

              deleted by creator

  • DeltaTangoLima@reddrefuge.com
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 年前

    lol - fine by me. My private searx-ng instance already filters out Reddit from the results, and my Pi-holes block all known Reddit domains.

  • kworpy@lemm.ee
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    2
    ·
    1 年前

    Your fault for using a major search engine honestly

Technology@lemmy.ml

technology@lemmy.ml

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@lemmy.ml

This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.


Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.


Rules:

1: All Lemmy rules apply

2: Do not post low effort posts

3: NEVER post naziped*gore stuff

4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.

5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)

6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist

7: crypto related posts, unless essential, are disallowed

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 224 users / day
  • 1.36K users / week
  • 2.56K users / month
  • 7.72K users / 6 months
  • 52 local subscribers
  • 38.9K subscribers
  • 4.74K Posts
  • 50.5K Comments
  • Modlog
  • mods:
  • MinutePhrase@lemmy.ml
  • BE: 0.19.6
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code
  • join-lemmy.org