I would agree that the interest will wain in some domains where they aren't aiding in productivity.

But LLMs for coding are productive right now in other domains and people aren't going to want to give that up.

Inference is already financially viable.

Now, I think what could crush the SOTA models is if they get sued into bankruptcy for copyright violations. Which is a related but separate thread.