219

We will use Grok 3.5 (maybe we should call it 4), which has advanced reasoning, to rewrite the entire corpus of human knowledge, adding missing information and deleting errors.

Then retrain on that.

Far too much garbage in any foundation model trained on uncorrected data.

Source.

More Context

Source.

Source.

(page 2) 50 comments
sorted by: hot top controversial new old
[-] Smokeless7048@lemmy.world 3 points 2 weeks ago

"and then on retrain on that"

Thats called model collapse.

[-] Sixtyforce@sh.itjust.works 3 points 2 weeks ago* (last edited 2 weeks ago)

I think most AI corp tech bros do want to control information, they just aren't high enough on Ket to say it out loud.

[-] wowwoweowza@lemmy.world 3 points 2 weeks ago

Meme image: Elon ducking his own tiny nub.

[-] someguy3@lemmy.world 3 points 2 weeks ago

This is the Ministry of Truth.

This is the Ministry of Truth on AI.

[-] Voroxpete@sh.itjust.works 3 points 2 weeks ago

Actually one of the characters in 1984 works in the department that produces computer generated romance novels. Orwell pretty accurately predicted the idea of AI slop as a propaganda tool.

[-] fluxion@lemmy.world 3 points 2 weeks ago

What a fucking idiot

[-] tonytins@pawb.social 3 points 2 weeks ago

That's a hell of way to say that he wants to rewrite history.

[-] umbraroze@slrpnk.net 2 points 2 weeks ago

Like all Point-Haired Bosses through the history, Elon has not heard of (or consciously chooses to ignore) one of the fundamental laws of computing: garbage in, garbage out

[-] Honytawk@feddit.nl 1 points 2 weeks ago

Maybe someone should write a new Art of War to explain to tech CEOs the basic ins and outs of technology development.

  • Like you can't throw more developers on a project to make it finish faster.
  • Cutting budgets isn't just free money, they come with detriments.
  • You can't scamp on security. It can take a single zero day to bankrupt a company.
  • There are limits to an internet connection. You can't expect everyone to have gigabit internet.

The basic shit every person working in the field understands. Except for the out-of-touch management. Call it the Art of Commerce or something.

[-] Don_alForno@feddit.org 1 points 2 weeks ago

Garbage out is what he aims for.

[-] LovableSidekick@lemmy.world 2 points 2 weeks ago* (last edited 2 weeks ago)

"We'll fix the knowledge base by adding missing information and deleting errors - which only an AI trained on the fixed knowledge base could do."

[-] Naevermix@lemmy.world 2 points 2 weeks ago

Elon Musk, like most pseudo intellectuals, has a very shallow understanding of things. Human knowledge is full of holes, and they cannot simply be resolved through logic, which Mush the dweeb imagines.

load more comments (4 replies)
[-] NikkiDimes@lemmy.world 2 points 2 weeks ago

Huh. I'm not sure if he's understood the alignment problem quite right.

[-] HugeNerd@lemmy.ca 2 points 2 weeks ago

He knows more ... about knowledge... than... anyone alive now

[-] JustAPenguin@lemmy.world 2 points 2 weeks ago

The thing that annoys me most is that there have been studies done on LLMs where, when trained on subsets of output, it produces increasingly noisier output.

Sources (unordered):

Whatever nonsense Muskrat is spewing, it is factually incorrect. He won't be able to successfully retrain any model on generated content. At least, not an LLM if he wants a successful product. If anything, he will be producing a model that is heavily trained on censored datasets.

[-] brucethemoose@lemmy.world 1 points 2 weeks ago* (last edited 2 weeks ago)

It's not so simple, there are papers on zero data 'self play' or other schemes for using other LLM's output.

Distillation is probably the only one you'd want for a pretrain, specifically.

[-] PattyMcB@lemmy.world 1 points 2 weeks ago

Faek news!

What a dickbag. I'll never forgive him for bastardizing one of my favorite works of fiction (Stranger in a Strange Land)

[-] Honytawk@feddit.nl 1 points 2 weeks ago

I believe it won't work.

They would have to change so much info that won't make a coherent whole. So many alternative facts that clash with so many other aspects of life. So asking about any of it would cause errors because of the many conflicts.

Sure it might work for a bit, but it would quickly degrade and will be so much slower than other models since it needs to error correct constantly.

An other thing is that their training data will also be very limited, and they would have to check every single other one thoroughly for "false info". Increasing their manual labour.

[-] TheFogan@programming.dev 1 points 2 weeks ago

I love that he can call things "objectively false", but then not actually try and counterpoint any of them. It's wrong because it disagrees with what I believe. Is he going to claim the amounts are wrong, or that Jan 6th is not right wing. Disagree that left wing violence is at the extreme ends targeting property?

Grok is at least showing examples to explain it's conclusion, musk is just copying trumps "nope fake news".

[-] qarbone@lemmy.world 1 points 2 weeks ago

You want to have a non-final product write the training for the next level of bot? Sure, makes sense if you're stupid. Why did all these companies waste time stealing when they could just have one bot make data for the next bot to train on? Infinite data!

[-] MangioneDontMiss@lemmy.ca 1 points 2 weeks ago

i'll allow it so long as grok acknowledges that musk was made rich from inherited wealth that was created using an apartheid emerald mine.

[-] Hossenfeffer@feddit.uk 1 points 2 weeks ago

He's been frustrated by the fact that he can't make Wikipedia 'tell the truth' for years. This will be his attempt to replace it.

[-] wrinkledoo@sh.itjust.works 1 points 2 weeks ago

There are thousands of backups of wikipedia, and you can download the entire thing legally, for free.

He'll never be rid of it.

Wikipedia may even outlive humanity, ever so slightly.

load more comments (1 replies)
[-] Sabin10@lemmy.world 1 points 2 weeks ago

I've seen what happens when image generating AI trains on AI art and I can't wait to see the same thing for "knowledge"

[-] friend_of_satan@lemmy.world 1 points 2 weeks ago* (last edited 2 weeks ago)

This is just vibe written ~~fantasy~~ historical fiction.

[-] clutchtwopointzero@lemmy.world 1 points 2 weeks ago

Grok will round up physics constants and pi as well... nothing will work but Musk will say that humanity is dumb

[-] ThePiedPooper@discuss.online 1 points 1 week ago

Grandiose delusions from a ketamine-rotted brain.

[-] AbidanYre@lemmy.world 1 points 2 weeks ago

I have Twitter blocked at my router.

Please tell me one of the "politically incorrect but objectively true" facts was that Elon is a pedophile.

[-] SoftestSapphic@lemmy.world 1 points 2 weeks ago

I remember when I learned what corpus meant too

load more comments
view more: ‹ prev next ›
this post was submitted on 22 Jun 2025
219 points (95.8% liked)

Technology

72472 readers
1023 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS