767
OpenAI be like (lemmy.zip)
submitted 2 days ago by cm0002@lemmy.zip to c/memes@sopuli.xyz
you are viewing a single comment's thread
view the rest of the comments
[-] dharmacurious@slrpnk.net 7 points 1 day ago

I really appreciate that! I was asking more for the information of it, I doubt I could do anything with the link. Lol. I don't understand thing 1 about this stuff. I don't even know wtf a weight is in this context lol

[-] edinbruh@feddit.it 7 points 1 day ago* (last edited 1 day ago)

In this context "weight" is a mathematical term. Have you ever heard the term "weighted average"? Basically it means calculating an average where some elements are more "influent/important" than others, the number that indicates the importance of an element is called a weight.

One oversimplification of how any neural network work could be this:

  • The NN receives some values in input
  • The NN calculates many weighted averages from those values. Each average uses a different list of weights.
  • The NN does a simple special operation on each average. It's not important what the operation actually is, but it must be there. Without this, every NN would be a single layer. It can be anything except sums and multiplications
  • The modified averages are the input values for the next layer.
  • Each layer has different lists of weights.
  • In reality this is all done using some mathematical and computational tricks, but the basic idea is the same.

Training an AI means finding the weights that give the best results, and thus, for an AI to be open-source, we need both the weights and the training code that generated them.

Personally, I feel that we should also have the original training data itself to call it open source, not just weights and code.

[-] Vex_Detrause@lemmy.ca 1 points 4 hours ago

What does the open source training data include? I've read a few open source training data that is also tested for biased but I haven't really looked at them.

[-] MrMcGasion@lemmy.world 4 points 1 day ago

Absolutely agree that to be called open source the training data should also be open. It would also pretty much mean that true open source models would be ethically trained.

[-] dovah@lemmy.world 1 points 1 day ago

Yeah, good call. Training data should be available as well.

[-] dharmacurious@slrpnk.net 1 points 1 day ago

Thank you!

And yeah, it really does seem like the training data should be open. Like, not even just to be considered open source, just to be allowed to do this at all, ethically, the training data should be known, at least to some degree. Like, there's so much shit out there, knowing what they trained on would help make some kind of ethical choice in using it

this post was submitted on 14 Oct 2025
767 points (99.4% liked)

Memes

12656 readers
979 users here now

Post memes here.

A meme is an idea, behavior, or style that spreads by means of imitation from person to person within a culture and often carries symbolic meaning representing a particular phenomenon or theme.

An Internet meme or meme, is a cultural item that is spread via the Internet, often through social media platforms. The name is by the concept of memes proposed by Richard Dawkins in 1972. Internet memes can take various forms, such as images, videos, GIFs, and various other viral sensations.


Laittakaa meemejä tänne.

founded 3 years ago
MODERATORS