"and then on retrain on that"
Thats called model collapse.
"and then on retrain on that"
Thats called model collapse.
I think most AI corp tech bros do want to control information, they just aren't high enough on Ket to say it out loud.
Meme image: Elon ducking his own tiny nub.
This is the Ministry of Truth.
This is the Ministry of Truth on AI.
Actually one of the characters in 1984 works in the department that produces computer generated romance novels. Orwell pretty accurately predicted the idea of AI slop as a propaganda tool.
What a fucking idiot
That's a hell of way to say that he wants to rewrite history.
Like all Point-Haired Bosses through the history, Elon has not heard of (or consciously chooses to ignore) one of the fundamental laws of computing: garbage in, garbage out
Maybe someone should write a new Art of War to explain to tech CEOs the basic ins and outs of technology development.
The basic shit every person working in the field understands. Except for the out-of-touch management. Call it the Art of Commerce or something.
Garbage out is what he aims for.
"We'll fix the knowledge base by adding missing information and deleting errors - which only an AI trained on the fixed knowledge base could do."
Elon Musk, like most pseudo intellectuals, has a very shallow understanding of things. Human knowledge is full of holes, and they cannot simply be resolved through logic, which Mush the dweeb imagines.
Huh. I'm not sure if he's understood the alignment problem quite right.
He knows more ... about knowledge... than... anyone alive now
The thing that annoys me most is that there have been studies done on LLMs where, when trained on subsets of output, it produces increasingly noisier output.
Sources (unordered):
Whatever nonsense Muskrat is spewing, it is factually incorrect. He won't be able to successfully retrain any model on generated content. At least, not an LLM if he wants a successful product. If anything, he will be producing a model that is heavily trained on censored datasets.
It's not so simple, there are papers on zero data 'self play' or other schemes for using other LLM's output.
Distillation is probably the only one you'd want for a pretrain, specifically.
Faek news!
What a dickbag. I'll never forgive him for bastardizing one of my favorite works of fiction (Stranger in a Strange Land)
I believe it won't work.
They would have to change so much info that won't make a coherent whole. So many alternative facts that clash with so many other aspects of life. So asking about any of it would cause errors because of the many conflicts.
Sure it might work for a bit, but it would quickly degrade and will be so much slower than other models since it needs to error correct constantly.
An other thing is that their training data will also be very limited, and they would have to check every single other one thoroughly for "false info". Increasing their manual labour.
I love that he can call things "objectively false", but then not actually try and counterpoint any of them. It's wrong because it disagrees with what I believe. Is he going to claim the amounts are wrong, or that Jan 6th is not right wing. Disagree that left wing violence is at the extreme ends targeting property?
Grok is at least showing examples to explain it's conclusion, musk is just copying trumps "nope fake news".
You want to have a non-final product write the training for the next level of bot? Sure, makes sense if you're stupid. Why did all these companies waste time stealing when they could just have one bot make data for the next bot to train on? Infinite data!
i'll allow it so long as grok acknowledges that musk was made rich from inherited wealth that was created using an apartheid emerald mine.
He's been frustrated by the fact that he can't make Wikipedia 'tell the truth' for years. This will be his attempt to replace it.
There are thousands of backups of wikipedia, and you can download the entire thing legally, for free.
He'll never be rid of it.
Wikipedia may even outlive humanity, ever so slightly.
I've seen what happens when image generating AI trains on AI art and I can't wait to see the same thing for "knowledge"
This is just vibe written ~~fantasy~~ historical fiction.
Grok will round up physics constants and pi as well... nothing will work but Musk will say that humanity is dumb
Grandiose delusions from a ketamine-rotted brain.
I have Twitter blocked at my router.
Please tell me one of the "politically incorrect but objectively true" facts was that Elon is a pedophile.
I remember when I learned what corpus meant too
This is a most excellent place for technology news and articles.