E-discovery and market simulation tools have basically been using these sort of models for a long time. I think "AI" is a misnomer and more of a branding/marketing term, reserved for the latest iteration of these tools, what used to be called "AI" is given a generic term describing it's use, and the new thing becomes AI until the next significant improvements are made and it happens again.

The thing where people think these new language models are going to create a "real" artificial intelligence basically confirms this, it's almost a religious belief. The mythology around this iteration of "AI" is creating hype beyond what it's technically capable of.