123
submitted 2 years ago by L4s@lemmy.world to c/technology@lemmy.world

ChatGPT has a style over substance trick that seems to dupe people into thinking it's smart, researchers found::Developers often prefer ChatGPT's responses about code to those submitted by humans, despite the bot frequently being wrong, researchers found.

you are viewing a single comment's thread
view the rest of the comments
[-] joe@lemmy.world 69 points 2 years ago

A caveat: This user analysis involved just 12 programmers being asked to assess if they prefer the responses of ChatGPT or those written by humans on Stack Overflow to 2,000 randomly sampled questions.

Nothing to see here.

[-] lemann@lemmy.one 11 points 2 years ago

12 programmers? That ChatGPT sample size is way too small to be meaningful IMO

[-] HellAwaits@lemm.ee -4 points 2 years ago

This is the one profession I don't mind AI taking jobs away from. Maybe that's a bit harsh, but I'm so sick and tired of the clickbait BS.

[-] joe@lemmy.world 1 points 2 years ago

This is the inevitable result of the decision to fund the internet at large via ads. And there would be (has been) tremendous friction from users when it comes to switching from ad-based to subscription, so we might just be stuck with it.

this post was submitted on 15 Aug 2023
123 points (88.2% liked)

Technology

72869 readers
1597 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS