That's an issue inherent to the d20 system, although 5e is way worse about it. WoD and CoD have way better systems for this, even though they aren't about combat.