What a fucking idiot
"and then on retrain on that"
Thats called model collapse.
I think most AI corp tech bros do want to control information, they just aren't high enough on Ket to say it out loud.
If we would talk like this, we’d end up in a padded room and drugged to kingdom come. And for good reason, I should say.
That's a hell of way to say that he wants to rewrite history.
Meme image: Elon ducking his own tiny nub.
Elon Musk, like most pseudo intellectuals, has a very shallow understanding of things. Human knowledge is full of holes, and they cannot simply be resolved through logic, which Mush the dweeb imagines.
Like all Point-Haired Bosses through the history, Elon has not heard of (or consciously chooses to ignore) one of the fundamental laws of computing: garbage in, garbage out
Maybe someone should write a new Art of War to explain to tech CEOs the basic ins and outs of technology development.
- Like you can't throw more developers on a project to make it finish faster.
- Cutting budgets isn't just free money, they come with detriments.
- You can't scamp on security. It can take a single zero day to bankrupt a company.
- There are limits to an internet connection. You can't expect everyone to have gigabit internet.
The basic shit every person working in the field understands. Except for the out-of-touch management. Call it the Art of Commerce or something.
Garbage out is what he aims for.
"We'll fix the knowledge base by adding missing information and deleting errors - which only an AI trained on the fixed knowledge base could do."
Huh. I'm not sure if he's understood the alignment problem quite right.
He knows more ... about knowledge... than... anyone alive now
The thing that annoys me most is that there have been studies done on LLMs where, when trained on subsets of output, it produces increasingly noisier output.
Sources (unordered):
- What is model collapse?
- AI models collapse when trained on recursively generated data
- Large Language Models Suffer From Their Own Output: An Analysis of the Self-Consuming Training Loop
- Collapse of Self-trained Language Models
Whatever nonsense Muskrat is spewing, it is factually incorrect. He won't be able to successfully retrain any model on generated content. At least, not an LLM if he wants a successful product. If anything, he will be producing a model that is heavily trained on censored datasets.
It's not so simple, there are papers on zero data 'self play' or other schemes for using other LLM's output.
Distillation is probably the only one you'd want for a pretrain, specifically.
Grandiose delusions from a ketamine-rotted brain.
I believe it won't work.
They would have to change so much info that won't make a coherent whole. So many alternative facts that clash with so many other aspects of life. So asking about any of it would cause errors because of the many conflicts.
Sure it might work for a bit, but it would quickly degrade and will be so much slower than other models since it needs to error correct constantly.
An other thing is that their training data will also be very limited, and they would have to check every single other one thoroughly for "false info". Increasing their manual labour.
Faek news!
What a dickbag. I'll never forgive him for bastardizing one of my favorite works of fiction (Stranger in a Strange Land)
You want to have a non-final product write the training for the next level of bot? Sure, makes sense if you're stupid. Why did all these companies waste time stealing when they could just have one bot make data for the next bot to train on? Infinite data!
I love that he can call things "objectively false", but then not actually try and counterpoint any of them. It's wrong because it disagrees with what I believe. Is he going to claim the amounts are wrong, or that Jan 6th is not right wing. Disagree that left wing violence is at the extreme ends targeting property?
Grok is at least showing examples to explain it's conclusion, musk is just copying trumps "nope fake news".
i'll allow it so long as grok acknowledges that musk was made rich from inherited wealth that was created using an apartheid emerald mine.
He's been frustrated by the fact that he can't make Wikipedia 'tell the truth' for years. This will be his attempt to replace it.
There are thousands of backups of wikipedia, and you can download the entire thing legally, for free.
He'll never be rid of it.
Wikipedia may even outlive humanity, ever so slightly.
I've seen what happens when image generating AI trains on AI art and I can't wait to see the same thing for "knowledge"
This is just vibe written ~~fantasy~~ historical fiction.
I remember when I learned what corpus meant too
Grok will round up physics constants and pi as well... nothing will work but Musk will say that humanity is dumb
Humm....this doesn't sound great
Technology
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.

