130
submitted 2 months ago* (last edited 2 months ago) by plinky@hexbear.net to c/technology@hexbear.net
you are viewing a single comment's thread
view the rest of the comments
[-] piggy@hexbear.net 25 points 2 months ago

You can distill your own models based on your own models, the fact that OpenAI isn't doing this is more evidence that they are "competing" via investment capital and not tech.

[-] JohnBrownsBussy2@hexbear.net 23 points 2 months ago

OpenAI does this all the time. For example, all the models they offer for free users (like o1-mini or 3.5-turbo) are distilled models. The DeepSeek R1 is impressive because it's not a distilled model in the technical sense, but still has the cost benefits of distillation.

[-] Z_Poster365@hexbear.net 6 points 2 months ago

right if it was so easy to "distill" and "copy" then why haven't they done this to themselves for a more efficient model?

this post was submitted on 29 Jan 2025
130 points (97.8% liked)

technology

23635 readers
252 users here now

On the road to fully automated luxury gay space communism.

Spreading Linux propaganda since 2020

Rules:

founded 4 years ago
MODERATORS