127
submitted 1 day ago* (last edited 1 day ago) by plinky@hexbear.net to c/technology@hexbear.net
you are viewing a single comment's thread
view the rest of the comments
[-] piggy@hexbear.net 24 points 1 day ago

You can distill your own models based on your own models, the fact that OpenAI isn't doing this is more evidence that they are "competing" via investment capital and not tech.

[-] JohnBrownsBussy2@hexbear.net 22 points 1 day ago

OpenAI does this all the time. For example, all the models they offer for free users (like o1-mini or 3.5-turbo) are distilled models. The DeepSeek R1 is impressive because it's not a distilled model in the technical sense, but still has the cost benefits of distillation.

[-] Z_Poster365@hexbear.net 6 points 1 day ago

right if it was so easy to "distill" and "copy" then why haven't they done this to themselves for a more efficient model?

this post was submitted on 29 Jan 2025
127 points (97.7% liked)

technology

23495 readers
289 users here now

On the road to fully automated luxury gay space communism.

Spreading Linux propaganda since 2020

Rules:

founded 4 years ago
MODERATORS