322
rulebots.txt (lemmy.world)
you are viewing a single comment's thread
view the rest of the comments
[-] Aeri@lemmy.world 67 points 1 year ago

oh no, Reddit is like, the only way to have google still be useful.

[-] germanatlas@lemmy.blahaj.zone 55 points 1 year ago

Funnily enough, google is also the only way to have Reddit be useful.

Their own search function has been nothing but garbage.

[-] morgunkorn@discuss.tchncs.de 44 points 1 year ago

That's the catch, Google made a deal with Reddit and remains the only search engine allowed to access its data for indexing. It cuts off every other search engine

[-] Vorticity@lemmy.world 28 points 1 year ago

Tell me that there is an anti trust suit over this.

[-] GroupNebula563@lemmy.world 27 points 1 year ago

There's a suit over google in general so this may well be part of it

[-] TriflingToad@lemmy.world 3 points 1 year ago

really? ddg will show me reddit links, did they have to make a webscraper or something

[-] morgunkorn@discuss.tchncs.de 4 points 1 year ago

There's a cutoff date, anything indexed before the robots.txt was changed stays in the index

[-] riodoro1@lemmy.world 31 points 1 year ago

We fucked the internet. It’s proprietary now.

[-] GroupNebula563@lemmy.world 11 points 1 year ago* (last edited 1 year ago)
[-] pupbiru@aussie.zone 8 points 1 year ago
[-] Swedneck@discuss.tchncs.de 2 points 1 year ago

cat5-o-nine-tails

[-] princessnorah@lemmy.blahaj.zone 9 points 1 year ago

Good news! Google paid up and still has access I'm pretty sure.

[-] GroupNebula563@lemmy.world 1 points 1 year ago

That's bad news, that means the internet is dying

[-] princessnorah@lemmy.blahaj.zone 1 points 1 year ago

Sorry, the /s was sort of implied.

[-] GroupNebula563@lemmy.world 2 points 1 year ago

Ah, sorry. I have trouble with that sometimes :P

this post was submitted on 21 Aug 2024
322 points (100.0% liked)

196

18690 readers
594 users here now

Be sure to follow the rule before you head out.


Rule: You must post before you leave.



Other rules

Behavior rules:

Posting rules:

NSFW: NSFW content is permitted but it must be tagged and have content warnings. Anything that doesn't adhere to this will be removed. Content warnings should be added like: [penis], [explicit description of sex]. Non-sexualized breasts of any gender are not considered inappropriate and therefore do not need to be blurred/tagged.

If you have any questions, feel free to contact us on our matrix channel or email.

Other 196's:

founded 2 years ago
MODERATORS