Yes, common objections are that the economy could crash or that humanity could go extinct. I don't think these are good objections, and I have different reasons. It seems like a bad "an end justifies the means" way of thinking sometimes.

Honestly, the economic crash one is weird. The logic is that we must sacrifice our present and immediate future (that happens to be millions of lives) so that other lives are better (supposedly). Huh? It reminds me of the argument I heard against prohibiting animals in circuses. They argue that the animals that were in the circuses at the time would be slaughtered or abandoned, so their logic was allowing more and more years of animals suffering inside the circuses. What? Yes, the change definitely hurt, but it was possible both to fight against their slaughter and abandonment, and to get rid of that abuse forever. If we decrease in population, of course it will be difficult, but we can find ways to face the difficulties while we get into a better system. We cannot preserve capitalism just because we are afraid of hard times, when capitalism itself is hurting us.

The extinction one is different. We won't get to that point, but even if we did, it would be a free decision of humanity that is hurting no one else. That's the intuition they probably have: that those humans would be hurting the ones that do not exist yet, but I already commented about that reasoning. I don't think there's harm against the non-existant. Our end is possibly inevitable because the habitable Universe seems to have an end. If we decide to fight it, that's okay as long as we do it ethically. But if we collectively decide to end it all, I respect it as long as it's done ethically too. Anyway, as I said, this is mere imagination as I do not see humanity (in the big numbers we now are) never ever choosing this path together. We will be here for some time.