I'd say this is mostly due to budget constraints. Voice acting, music scores, high fidelity art, models, animations etc cost a ton of money. Making random generated boards / levels / dungeons with simple art and scalable gameplay is simply just more feasible.

Another aspect is the popularity of the game. We've seen a lot of saturation in genres over the years. A the peak of PUBG and Fortnite popularity, there were so many battle royale games coming out. Then we got extraction shooters, and so on.

Personally, I love roguelikes and how we got to the point of mixing it with other genres (Balatro, Dungeon Clawler), but I can see your point. I feel the same about 2D (pixel art) platformers: I feel like I've seen it all already and nothing can excite me anymore.