16
AGI is Mathematically Impossible 2: When Entropy Returns
(philarchive.org)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 22 Jun 2025
16 points (80.8% liked)
Hacker News
2200 readers
521 users here now
Posts from the RSS Feed of HackerNews.
The feed sometimes contains ads and posts that have been removed by the mod team at HN.
founded 11 months ago
MODERATORS
Do you have a link to some of that evidence? What do you mean by general intelligence in comparison to AGI? (artificial general intelligence)
The human brain is a neural network that operates on less than 100 Watts of energy. So it’s obviously not physically impossible.
There’s no scaling law that invalidates general intelligence, only ones that invalidate the exact, unmodified techniques we use today. At any time someone could find a more efficient way to do things and turn the whole world upside down.
Exactly. I would argue that brains are multiple neural networks working together in concert, however.
what's the difference between a single neural network and multiple neural networks? are BERTs multiple neural networks working together in concert, if you count the encoder and decoder separately? the different layers of a MoE? certainly VLMs count.
I don't think so. Think about the training process. All the nodes in those neural networks were trained on sets of data together. While certain sets of nodes may be more heavily responsible for the word, "pineapple", for example, those subsets cannot function outside the context of the whole network.
Now, what if you had an LLM that hallucinates, and you trained a second neural network whose only job was to fact-check the output of the first neural network? Those are 2 neural networks trained on separate data, for separate purposes that work in tandem to provide accurate responses.