123
submitted 1 year ago by L4s@lemmy.world to c/technology@lemmy.world

ChatGPT has a style over substance trick that seems to dupe people into thinking it's smart, researchers found::Developers often prefer ChatGPT's responses about code to those submitted by humans, despite the bot frequently being wrong, researchers found.

you are viewing a single comment's thread
view the rest of the comments
[-] sj_zero@lotide.fbxl.net 8 points 1 year ago

Anyone who has actually needed a correct answer to a question realized this a long time ago.

The problem is that most people don't bother checking the answers.

[-] GenderNeutralBro@lemmy.sdf.org 4 points 1 year ago

If you need a correct answer, you're doing it wrong!

I'm joking of course, but there's a seed of truth: I've found ChatGPT's wrong or incomplete answers to be incredibly helpful as a starting point. Sometimes it will suggest a Python module I didn't even know about that does half my work for me. Or sometimes it has a lot of nonsense but the one line I actually need is correct (or close enough for me to understand).

Nobody should be copying code off Stack Overflow without understanding it, either.

[-] sumofchemicals@lemmy.world 0 points 1 year ago

This hasn't been my experience. Yes, chatgpt gets stuff wrong, and fairly regularly. But I can ask it my question directly, and can include sample code, and I get an answer immediately. Anyone going on stack overflow has to either google around and sift through answers for relevance, or has to post the question and wait for someone to respond.

With either chatgpt or stack you have to check the answer to make sure it works - that's how coding goes. But one I know if it works or not pretty much immediately with fairly low investment of time and effort. And if it doesn't, I just rephrase the question, or literally say "that doesn't seem to work, now I'm getting this error: $error"

this post was submitted on 15 Aug 2023
123 points (88.2% liked)

Technology

58852 readers
4643 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS