339

About as open source as a binary blob without the training data (slrpnk.net)

submitted 1 month ago by Prunebutt@slrpnk.net to c/memes@lemmy.world

50 comments fedilink hide all child comments

Office space meme:

"If y'all could stop calling an LLM "open source" just because they published the weights... that would be great."

you are viewing a single comment's thread
view the rest of the comments

[-] Prunebutt@slrpnk.net 3 points 1 month ago

it’s the entirety of the bulk unfiltered data you want

Or more realistically: a description of how you could source the data.

doesnt touch on at all how this LLM is different from other LLM’s?

Correct. Llama isn't open source, either.

like saying that an open source game emulator can’t be open source because Nintendo games are encapsulated

Not at all. It's like claiming an emulator is open source, because it has a plugin system, but you need a closed source build dependency that the developer doesn't disclose to the puplic.

[-] WraithGear@lemmy.world 1 points 1 month ago* (last edited 1 month ago)

Source build dependency… so you don’t have a problem with the LLM at all! You have a problem with the data collection process or the pre-training! So an emulator can’t be open source if the methodology on how the developers discovered how to read Nintendo ROM’s was not disclosed? Or which games were dissected in order to reverse engineer that info? I don’t consider that a prerequisite to say an emulator is open

So if i say… remove the data set from deepseek what remains would be considered open source by you?

[-] Prunebutt@slrpnk.net 1 points 1 month ago

So an emulator can’t be open source if the methodology on how the developers discovered how to read Nintendo ROM’s was discovered?

No. The emulator is open source if it supplies the way on hou to get the binary in the end. I don't know how else to explain it to you: No LLM is open source.