187
submitted 2 months ago* (last edited 2 months ago) by nave@lemmy.ca to c/technology@lemmy.world

For OpenAI, o1 represents a step toward its broader goal of human-like artificial intelligence. More practically, it does a better job at writing code and solving multistep problems than previous models. But it’s also more expensive and slower to use than GPT-4o. OpenAI is calling this release of o1 a “preview” to emphasize how nascent it is.

The training behind o1 is fundamentally different from its predecessors, OpenAI’s research lead, Jerry Tworek, tells me, though the company is being vague about the exact details. He says o1 “has been trained using a completely new optimization algorithm and a new training dataset specifically tailored for it.”

OpenAI taught previous GPT models to mimic patterns from its training data. With o1, it trained the model to solve problems on its own using a technique known as reinforcement learning, which teaches the system through rewards and penalties. It then uses a “chain of thought” to process queries, similarly to how humans process problems by going through them step-by-step.

At the same time, o1 is not as capable as GPT-4o in a lot of areas. It doesn’t do as well on factual knowledge about the world. It also doesn’t have the ability to browse the web or process files and images. Still, the company believes it represents a brand-new class of capabilities. It was named o1 to indicate “resetting the counter back to 1.”

I think this is the most important part (emphasis mine):

As a result of this new training methodology, OpenAI says the model should be more accurate. “We have noticed that this model hallucinates less,” Tworek says. But the problem still persists. “We can’t say we solved hallucinations.”

you are viewing a single comment's thread
view the rest of the comments
[-] ContrarianTrail@lemm.ee 18 points 2 months ago

It may not be capable of truly understanding anything, but it sure seems to do a better job of it than the vast majority of people I talk to online. I might spend 45 minutes carefully typing out a message explaining my view, only for the other person to completely miss every point I made. With ChatGPT, though, I can speak in broken English, and it’ll repeat back the point I was trying to make much more clearly than I could ever have done myself.

[-] NoForwardslashS@sopuli.xyz 16 points 2 months ago

I heard parrots are the pinnacle of conversation

[-] Voroxpete@sh.itjust.works 5 points 2 months ago

I hate to say it bud, but the fact that you feel like you have more productive conversations with highly advanced autocomplete than you do with actual humans probably says more about you than it does about the current state of generative AI.

[-] ContrarianTrail@lemm.ee 7 points 2 months ago

That's not what I said, though.

[-] Badeendje@lemmy.world 4 points 2 months ago

LoL. You're proving his point for him. He did not say that at all. Or maybe that's the joke.. I dunno.

[-] Zos_Kia@lemmynsfw.com -2 points 2 months ago

You should have asked chatgpt to explain the comment to you cause that's not what they say

[-] Eximius@lemmy.world 3 points 2 months ago

It's a (large) language model. It's good at language tasks. Helps to have hundreds of Gigs of written "knowledge" in ram. Differing success rates on how that knowledge is connected.

It's autocorrect so turbocharged, it can write math, and a full essay without constantly clicking the buttons on top of the iphone keyboard.

You want to keep a pizza together? Ah yes my amazing concepts of sticking stuff together tells me you should add 1/2 spoons of glue (preferably something strong like gorilla glue).

How to find enjoyment with rock? Ah, you can try making it as a pet, and having a pet rock. Having a pet brings many enjoyments such as walking it.

[-] ContrarianTrail@lemm.ee 6 points 2 months ago

Thanks for illustrating my point.

[-] echodot@feddit.uk 5 points 2 months ago

You want to keep a pizza together? Ah yes my amazing concepts of sticking stuff together tells me you should add 1/2 spoons of glue

That would be a good test to ask it that question and see if it comes up with a more coherent answer.

[-] Cryophilia@lemmy.world -1 points 2 months ago

Skill issue. Read more books.

this post was submitted on 12 Sep 2024
187 points (88.2% liked)

Technology

59648 readers
1490 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS