it's difficult to merge that deep simulation system with the capability to do narrative traditional game design
Definitely, games that try this do need to abandon traditional narratives to some extent, which is a big ask for a typical publisher - and unfortunately, the complexity of such systems also puts them out of the reach of indie games which can otherwise afford to be more experimental (although Rain World is supposed to have some pretty amazing AI simulation too) - these kind of projects really have to be AA games, big enough to manage the complexity, but small enough to be allowed to actually do it instead of flattening everything in pursuit of more market share. And the AA side of the industry has unfortunately massively declined.
Space Rangers' main narrative isn't really much more than "liberate all star systems and defeat the big boss commanding the enemy" - there's a bit of detail about the war itself, but it's mostly revealed in big text boxes, which is moreso lore than narrative I guess. However, it's still got plenty of stories, thanks to the baffling(ly amazing) decision to just stick like a 100 mini-text-adventure games in as side quests. Get caught by the cops for your piratical crimes and sent to jail? Oh boy, we've got a whole text adventure of you having to manage your relations with the prisoners and the guards, choosing who to snitch on, getting into, uh, trained cockroach races (?), ratting out the horrible prison conditions to journalists, and much more! There's also presidential elections, cooking competitions, just a whole ton of random stuff, I have no idea what they were thinking but it turned out pretty great.
Grand strategy games like Crusader Kings also utilize such dynamic systems to great effect while forsaking typical narrative, but they're their own niche (and while Paradox does make cool stuff, they do also nickel-and-dime people for like 100 different DLCs per game...)
I stumbled on the OST for the unreleased Jazz Jackrabbit 3 recently, and I keep playing this track every now and again, it's such a banger. This whole subgenre from Epic Games' early efforts (and stuff those composers did for other companies) is really cool, I with there more games beyond the Unreals and Deus Ex with that style. This track from Unreal 2 is another great one
The cut Downtown theme from Vampire: the Masquerade - Bloodlines, it's just such a vibe
Fertile Rondo from Bayonetta 3 is also just , great 5th Element vibes
Brain Freeze from Yuri's Revenge, I miss the "just stick some old movie/TV quotes in" era of electronic music
This track from Descent (this particular recording off a Roland SC-55, I'm pretty sure I originally found it on youtube but it seems like that upload may have been taken down, and a lot of the other ones I could find don't sound as good)
The whole Neotokyo soundtrack really, just an absolute masterpiece composed for a free mod for some reason. Some standouts: Beacon, Imbrium, Tachi, I just absolutely love the combination of more electronic sounds with strings and piano in a lot of these.
On the more ambient side of things, STALKER has some great ones, Call of Pripyat especially, like the Pripyat theme