341
submitted 1 week ago* (last edited 1 week ago) by brianpeiris@lemmy.ca to c/programming@programming.dev

In case you missed it, ChatGPT 5.1 had a tendency to talk about "goblins" in its responses. Supposedly this was a result of training a "nerdy" personality, but it bled into the model as a whole. Because the training run for the latest model already had this flaw, they had to add specific instructions to the system prompt for their Codex coding tool to avoid this behaviour.

Here's the full prompt from their github. In fact, they repeated the goblin instructions twice, cos you know that will definitely fix it. It's an interesting read if you consider each one of these instructions were meant to prevent some undesired behaviour: https://paste.sh/Iev3HtMe#JZ4dw_CkvJcpVmjjoy7WZnSn

More info here: https://news.northeastern.edu/2026/05/06/chatgpt-goblins-problem-ai-behavior/

OpenAI's own blog post casually explaining why they couldn't predict that their state of the art model would obsess about goblins: https://openai.com/index/where-the-goblins-came-from/

you are viewing a single comment's thread
view the rest of the comments
[-] affenlehrer@feddit.org 14 points 1 week ago

I usually allow it to speak about goblins

[-] thingsiplay@lemmy.ml 7 points 1 week ago

To be fair, the rule doesn't prohibit talking about goblins entirely. It just has to be absolutely necessary and relevant to the user query.

[-] affenlehrer@feddit.org 2 points 1 week ago

Yeah and allowing it specifically adds goblin analogies to pretty much anything you talk about, at least in my experience. I kinda like it though

this post was submitted on 16 May 2026
341 points (98.0% liked)

Programming

27035 readers
166 users here now

Welcome to the main community in programming.dev! Feel free to post anything relating to programming here!

Cross posting is strongly encouraged in the instance. If you feel your post or another person's post makes sense in another community cross post into it.

Hope you enjoy the instance!

Rules

Rules

  • Follow the programming.dev instance rules
  • Keep content related to programming in some way
  • If you're posting long videos try to add in some form of tldr for those who don't want to watch videos

Wormhole

Follow the wormhole through a path of communities !webdev@programming.dev



founded 3 years ago
MODERATORS