303
Microsoft CEO Admits That AI Is Generating Basically No Value
(ca.finance.yahoo.com)
This is a most excellent place for technology news and articles.
alphafold is not an LLM, so no, not really
You are correct that AlphaFold is not an LLM, but they are both possible because of the same breakthrough in deep learning, the transformer and so do share similar architecture components.
And all that would not have been possible without linear algebra and calculus, and so on and so forth... Come on, the work on transformers is clearly separable from deep learning.
A Large Language Model is a translator basically, all it did was bridge the gap between us speaking normally and a computer understanding what we are saying.
The actual decisions all these "AI" programs do are Machine Learning algorithms, and these algorithms have not fundamentally changed since we created them and started tweaking them in the 90s.
AI is basically a marketing term that companies jumped on to generate hype because they made it so the ML programs could talk to you, but they're not actually intelligent in the same sense people are, at least by the definitions set by computer scientists.
What algorithm are you referring to?
The fundamental idea to use matrix multiplication plus a non linear function, the idea of deep learning i.e. back propagating derivatives and the idea of gradient descent in general, may not have changed but the actual algorithms sure have.
For example, the transformer architecture (that is utilized by most modern models) based on multi headed self attention, optimizers like adamw, the whole idea of diffusion for image generation are I would say quite disruptive.
Another point is that generative ai was always belittled in the research community, until like 2015 (subjective feeling would need meta study to confirm). The focus was mostly on classification something not much talked about today in comparison.