No, you're misunderstanding the nature of the Fediverse. The fediverse concept centers around independent servers interconnecting and communicating with each other over activitypub, not all servers everywhere, just simply independent servers (AKA there is room for defederation and bans in that model). There will be servers which choose not to or won't be allowed to interconnect and that isn't antithetical to the goal because the goal is having servers be able to do it. If you were told that fediverse means all activitypub servers interconnect they were either misunderstanding or lying.