The only ones in the vassals who might get pissed about it will be the petite bourgeoise and they'll just put that anger into fascism and blame immigrants instead of trying to dismantle empire. Based on what history has shown us when it comes to the proclivities of europeans.