I hear eugenists say "there's not enough people" in place of "we need more specially white folk so the uneducated colored don't replace us" far far more often, see Elon musk and the like.

I've actually only ever heard "there's too many people" come from anti capitalists.