534
Sam Altman fired as CEO of OpenAI
(www.theverge.com)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 17 Nov 2023
534 points (99.1% liked)
Technology
59708 readers
1536 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
Not exactly surprised here. Every time I've seen him on the news, it's always him fearmongering about the dangers of generative AI, when ChatGPT is burning through money and seemed to become more and more restrictive with every iteration. You can't run an organization if it is built on top of lies.
Actually open models (not open source, sadly) like specialized LLaMa 2 derivatives that could be ran and fine-tuned locally seems to be the future, because there seems to be a diminishing return in training/inference power to usefulness, and specialized smaller model tuned for specific applications are much more flexible than a giant general one that can only be used on somebody else's machine.
Be careful not to be caught up in the application of Goodhart's Law going on in the field right now.
There's plenty of things GPT-4 trounces everything else on, they just tend to be things outside the now standardized body of tests, which suggests the tests have become the target and are no longer effective measurements.
This is perhaps most apparent in things like Orca, where we directly use the tests as the target, have GPT-4 generate synthetic data that improves Llama performance on the target, and then see large gains in smaller models on the tests.
But those new models don't necessarily have the same capabilities on more abstract capabilities, such as the recent approach of using analogy to solve problems.
We are arguably becoming too myopic in how we are measuring the success of new models.