299
submitted 7 months ago by L4s@lemmy.world to c/technology@lemmy.world

Reddit has a new AI training deal to sell user content::Reddit has reportedly made a deal with an unnamed AI company to allow access to its platform’s content for the purposes of AI model training.

top 31 comments
sorted by: hot top controversial new old
[-] Lmaydev@programming.dev 26 points 7 months ago

I'd be very surprised if people weren't already scraping Reddit for this.

[-] NoRodent@lemmy.world 20 points 7 months ago* (last edited 7 months ago)

I mean, there's /r/SubSimulatorGPT2 that's been running for years... Although that one was at least hilarious to read because at that stage the AI was in the sweet spot of being simultaneously coherent while making total lapses in logic.

[-] TexasDrunk@lemmy.world 6 points 7 months ago

Didn't forget incredibly racist on multiple occasions.

[-] bbkpr@lemmy.world 2 points 7 months ago

The AI is what was fed into it 😂

[-] Verserk@lemmy.dbzer0.com 8 points 7 months ago

That was the real reason for the API changes last year, apps just got caught in the crossfire.

[-] fuckwit_mcbumcrumble@lemmy.world 3 points 7 months ago

Yeah I thought that was pretty well the established conscientious on the thing. People questioning it confuses me honestly.

[-] NeatNit@discuss.tchncs.de 6 points 7 months ago* (last edited 7 months ago)

it's all but guaranteed. Reminds me of this Computerphile video: https://youtu.be/WO2X3oZEJOA?t=874 TL;DW: there were "glitch tokens" in GPT (and therefore ChatGPT) which undeniably came from Reddit usernames.

Note, there's no proof that these reddit usernames were in the training data (and there's even reasons to assume that they weren't, watch the video for context) but there's no doubt that OpenAI already had scraped reddit data at some point prior to training, probably mixed in with all the rest of their text data. I see no reason to assume they completely removed all reddit text before training. The video suggest reasons and evidence that they removed certain subreddits, not all of reddit.

[-] PipedLinkBot@feddit.rocks 1 points 7 months ago

Here is an alternative Piped link(s):

https://piped.video/WO2X3oZEJOA?t=874

Piped is a privacy-respecting open-source alternative frontend to YouTube.

I'm open-source; check me out at GitHub.

[-] comrade19@lemmy.world 18 points 7 months ago

Why is there nothing on reddit about this lol

[-] bobs_monkey@lemm.ee 18 points 7 months ago

Mustn't spook the ~~product~~ users

[-] FartsWithAnAccent@lemmy.world 3 points 7 months ago

I'd be surprised if there wasn't, I don't think Spez and his cohorts are competent enough to completely suppress all information about it site wide.

[-] gwildors_gill_slits@lemmy.ca 18 points 7 months ago

Can't wait for chatGPT to call me good sir and tell me I win the internet.

[-] Buffalox@lemmy.world 12 points 7 months ago* (last edited 7 months ago)

The best answer I can find to you question is "deleted by user."

[-] ME5SENGER_24@lemmy.world 17 points 7 months ago

FUCK REDDIT! FUCK U/SPEZ! The Red-exit shall endure, VIVA LA LEMMY!!

[-] Boozilla@lemmy.world 14 points 7 months ago

I bet the fuckers will use "deleted" data, too

[-] General_Effort@lemmy.world 4 points 7 months ago

Deleted? You mean made unscrapeable. It's exclusive to Reddit licensees.

[-] redfox@infosec.pub 3 points 7 months ago* (last edited 7 months ago)

Yeah, the second anyone posts anything to any service, all their house are belong to the evil corp...

I just blended two references...

[-] tinwhiskers@lemmy.world 3 points 7 months ago

what about edited?

[-] KingThrillgore@lemmy.ml 10 points 7 months ago* (last edited 7 months ago)

When spez took away API access, he basically shit on the social contract that offered a fair exchange of free access for the content we fed into reddit. After the API change, there were new terms: there is no contract. There are no terms. If you use reddit now, you are giving away everything you are to be indexed and mangled by statistics. You exist as free labor to statisticians and machines.

You are more than a few cents of bad memes.

I'm going to make the request in the AM that Lemmy should add robots.txt rules to disallow AI crawlers, to at least indicate we're not interested. We need legislation that tells scrapers what they can access.

[-] General_Effort@lemmy.world 1 points 7 months ago

We need legislation that tells scrapers what they can access.

What do you hope that would achieve?

Because I can only see this as benefitting Reddit, Facebook, and the like, while screwing over smaller players.

[-] VerseAndVermin@lemmy.world 9 points 7 months ago

Can someone more savvy explain why they couldn't also scrape what we all say here?

[-] Crack0n7uesday@lemmy.world 10 points 7 months ago* (last edited 7 months ago)

They can and do, but they want the training models to come from highly moderated sources otherwise every AI chatbot would be spewing the most racist parts of 4chan because people would train it that way as a joke.

If you let AI roam freely across the internet, it would only learn porn, sailor moon, dragon Ball z, and nazi germany.

[-] bigkahuna1986@lemmy.ml 6 points 7 months ago

Ah yes, the Microsoft Tay conundrum.

[-] Crack0n7uesday@lemmy.world 2 points 7 months ago

Microsoft Bing AI image generator made some really weird porn before they realized what it was being used for...

[-] Verserk@lemmy.dbzer0.com 4 points 7 months ago

Anything can, the difference is reddit holds the exclusive rights to user comments on their site, and they've chosen to sell it.

[-] Steak@lemmy.ca 3 points 7 months ago

Dick dick pussy cunt cock dick pussy ass shit cunt shit motherfucker shit motherfucker ass tits cunt cock motherfucker shit ass tits motherfucker shit c'mon. Scrape that🔥

[-] lvxferre@mander.xyz 9 points 7 months ago* (last edited 7 months ago)

For anyone looking for a gibberish generator to replace their Reddit content with, here's one. This shit is like poison for those large models.

For automatic edition I'm not sure on what people can use nowadays; back then just before the APIcalypse I've used power delete suite, I'm not sure if it still works and I'm not creating a Reddit account just to test it out.

[-] greaprr@sh.itjust.works 1 points 7 months ago

Not that I’m against telling Reddit to fuck off in no uncertain terms, but won’t providing this kind of poisoning to AI training just make it more resilient to exactly this kind of thing?

[-] lvxferre@mander.xyz 1 points 7 months ago* (last edited 7 months ago)

I don't think so. It's really hard to sort the poison out of the data, unless you actually have enough reading comprehension to know that it's gibberish - humans do, bots don't. And even if they discard 80% of the poison, the 20% there are already screwing with the model.

They could prevent you from editing your posts/comments, but that would cause an uproar.

[-] General_Effort@lemmy.world 2 points 7 months ago

They say it’s $60 million on an annualized basis. I wonder who’d pay that, given that you can probably scrape it for free.

Maybe it’s the AI act in the EU. That might cause trouble in that regard. The US is seeing a lot of rent-seeker PR, too, of course. That might cause some to hedge their bets.

Maybe some people had not realized that yet, but limiting fair use does not just benefit the traditional media corporations but also the likes of Reddit, Facebook, Apple, etc. Making “robots.txt” legally binding would only benefit the tech companies.

[-] autotldr@lemmings.world 1 points 7 months ago

This is the best summary I could come up with:


Reddit will let “an unnamed large AI company” have access to its user-generated content platform in a new licensing deal, according to Bloomberg yesterday.

The deal, “worth about $60 million on an annualized basis,” the outlet writes, could still change as the company’s plans to go public are still in the works.

The news also follows an October story that Reddit had threatened to cut off Google and Bing’s search crawlers if it couldn’t make a training data deal with AI companies.

Last year, it successfully stonewalled its way out of the biggest protest in its history after changes to its third-party API access pricing caused developers of the most popular Reddit apps to shut down.

As Bloomberg writes, Reddit’s year-over-year revenue was up by 20 percent by the end of 2023, but it was still $200 million shy of a $1 billion target it had set two years prior.

The company was reportedly advised to seek a $5 billion valuation when it opens up for public investment, which is expected to happen in March.


The original article contains 346 words, the summary contains 175 words. Saved 49%. I'm a bot and I'm open source!

this post was submitted on 17 Feb 2024
299 points (97.8% liked)

Technology

58133 readers
4357 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS