I initially started on easy, but just found it far too complex of a system to get my head around, and when my work hours can see me going days between play sessions, any knowledge I do pick up often isn't retained. I also just don't enjoy turn based combat at all, so when I enter combat, I just throw on god mode and infinite turns to get it over and return to the story or quest more quickly (I'll often alter things depending on what's happening in the game at the time though. For example, I did the Gauntlet of Shar with Shadowheart on her own, as it felt like something she needed to tackle solo, even if I wasn't in any genuine danger.)

I guess tl;dr - even easy was a bit too much for me to take in given my work schedule, as well as the combat taking a lot of time away from the aspects of the game I love, namely exploration and stories.