I really hope people are starting to catch on, large language models aren't "intelligent", they're multidimensional maps of human language use and querying them is just tracing a vector "forward" through language-space from the starting point of a prompt.

It's the reification fallacy writ so large it's eclipsing entire national economies. Human intelligence isn't in language, language is a product of human intelligence. The map is not the territory.

And yeah, it is pretty cool that we have the processing power to map out language-space well enough to draw some vectors that remain coherent over thousands of tokens, but using a billion-parameter model to do what could be accomplished with probably-already-existing management software and a few seconds of CPU time per week is as wasteful as it is misguided.