644
Dreams come true
(mander.xyz)
A place for majestic STEMLORD peacocking, as well as memes about the realities of working in a lab.
Rules
Someone's probably already coined the term, but I'm going to call it LLM inbreeding.
I suggested this term in academic circles, as a joke.
I also suggested hallucinations ~3-6 years ago only to find out it was ALSO suggested in the 1970s.
Inbreeding, lol
There was some research article applying this 70s computer science concept to LLMs. It was published in Nature and hit major news outlets. Basically they further trained GPT on its output for a couple generations, until the model degraded terribly. Sounded obvious to me, but seeing it happen on the www is painful nonetheless...
The real term is synthetic data
but it amounts to about the same
sort of
Soylent AI? Auto-infocannibalism
It's quite similar to another situation known as data incest