The issue is that everyone has power over others. A man who farms has power over a man who doesn't. A charismatic extrovert has power over the friendless introvert. A man who knows a secret has power over a man who is unaware.

And that to assert that no one should have any power over others, ironically, strips one of the ability to ensure that no one has power over others. Even anarchist polities require people to be able to enforce rules on others; the institutional structures are simply weakened to create fluidity of power and, ideally, thus prevent its abuse.

All systems are compromises between constructing something with the power to achieve its goals (such as preventing the rise of traditional states, for example) and restraining it's own capabilities to prevent it from turning into something else (... like a traditional state. For example.)