It's one of those "if you won't respect me as an authority, I'm going to treat it like you aren't respecting me as a person". It all comes back to authoritarianism and maintaining hierarchies. Conservatives believe someone must be in charge and what that person says goes, and then an extension to that is they want to approve of who is in charge and do not want to follow a woman or minority.