I means, I’m I huge local LLM advocate. I look at slop metrics, I’ve finetuned or messed with smaller LLMs for prose. I use bigger MoEs with raw completion syntax to get past writers block and some probably-related-to-neurodivergence issues I have.

But they really are terrible with long-form stories.

There’s no way around it. They just can’t stick to a coherent plot.

And even at the “micro” scale (eg “I’m stuck, how do I finish this sentence?” or “how should this character realistically respond?” or “does this paragraph feel stilted?”) they’re only there for inspiration, or maybe as a mirror to bounce ideas off of. Not any sort of output you could rely on.

It absolutely boggles my mind people think they can replace, or even “double” writers. They don’t think. They are literally architected to be terrible at that, no matter how much koolaid on scaling Altman preaches.