67
Could real neurons be used for LLMs?
(lemm.ee)
A loosely moderated place to ask open-ended questions
Search asklemmy ๐
If your post meets the following criteria, it's welcome here!
Looking for support?
Looking for a community?
~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~
What on earth are you talking about?
A neural network is an array of layered nodes, where each node contains some kind of activation function, and each connection represents some weight multiplier. Importantly, once the model is trained, it's stateless, meaning we don't need to store any extra data to use it - just inputs and outputs.
If we could take some sort of material, like a glass, and modify it so that if you shone a light through one end, the light would bounce in such a way as to emulate these functions and weights, you could create an extremely cheap, compact, fast, and power efficient neural network. In theory, at least.
So just ML on an optical computer, or some sort of baseless sci-fi thing you made up?
A mix of both, but keep in mind that I'm commenting on a post about a related made up sci-fi idea.
It most certainly is not: https://www.technologyreview.com/2023/12/11/1084926/human-brain-cells-chip-organoid-speech-recognition/
Neural organoids have been a thing for a few years now.