657

submitted 4 months ago by roon@lemmy.ml to c/196@lemmy.blahaj.zone

63 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[-] technohacker@programming.dev 7 points 4 months ago* (last edited 4 months ago)

They stand for Floating Point 16-bit, 8-bit and 4 bit respectively. Normal floating point numbers are generally 32 or 64 bits in size, so if you're willing to sacrifice some range, you can save a lot of space used by the model. Oh, and it's about the model rather than the GPU