188
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 27 Dec 2024
188 points (94.8% liked)
Technology
60363 readers
916 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 2 years ago
MODERATORS
Human brains also do processing of audio, video, self learning, feelings, and many more that are definitely not statistical text. There are even people without "inner monologue" that function just fine
Some research does use LLM in combination with other AI to get better results overall, but purely LLM isn't going to work.
Yep, of course. We do more things.
But language is a big thing in the human intelligence and consciousness.
I don't know, and I would assume that anyone really know. But people without internal monologue I have a feeling that they have it but they are not aware of it. Or maybe they talk so much that all the monologue is external.
Interesting you focus on language. Because that's exactly what LLMs cannot understand. There's no LLM that actually has a concept of the meaning of words. Here's an excellent essay illustrating my point.
But this "concepts" of things are built on the relation and iteration of this concepts with our brain.
A baby doesn't born knowing that a table is a table. But they see a table, their parents say the word table, and they end up imprinting that what they have to say when they see that thing is the word table. That then they can relation with other things they know. I've watched some kids grow and learn how to talk lately and it's pretty evident how repetition precedes understanding. Many kids will just repeat words that they parents said in certain situation when they happen to be in the same situation. It's pretty obvious with small kids. But it's a behavior you can also see a lot with adults, just repeating something they heard once they see that particular words fit the context
Also it's interesting that language can actually influence the way concepts are constructed in the brain. For instance ancient greeks saw blue and green as the same colour, because they did only have one word for both colours.
But an LLM isn't actually language. It's numbers that represent tokens that build words. It doesn't have the concept of a table, just the numerical weighting of other tokens related to "tab" & "le".
I don't know how to tell you this. But your brain does not have words imprinted in it...
The concept of this is, funnily enough, something that is being studied that derived from language. For instance ancient greeks did not distinguish between green and blue, as both colours had the same word.