303
Microsoft CEO Admits That AI Is Generating Basically No Value
(ca.finance.yahoo.com)
This is a most excellent place for technology news and articles.
A Large Language Model is a translator basically, all it did was bridge the gap between us speaking normally and a computer understanding what we are saying.
The actual decisions all these "AI" programs do are Machine Learning algorithms, and these algorithms have not fundamentally changed since we created them and started tweaking them in the 90s.
AI is basically a marketing term that companies jumped on to generate hype because they made it so the ML programs could talk to you, but they're not actually intelligent in the same sense people are, at least by the definitions set by computer scientists.
What algorithm are you referring to?
The fundamental idea to use matrix multiplication plus a non linear function, the idea of deep learning i.e. back propagating derivatives and the idea of gradient descent in general, may not have changed but the actual algorithms sure have.
For example, the transformer architecture (that is utilized by most modern models) based on multi headed self attention, optimizers like adamw, the whole idea of diffusion for image generation are I would say quite disruptive.
Another point is that generative ai was always belittled in the research community, until like 2015 (subjective feeling would need meta study to confirm). The focus was mostly on classification something not much talked about today in comparison.