That's only if you assume male-to-female ratio of 1:1 if they had, say, 10 women for each man, they would only lose 10% of their population per generation. However, if roughly one in ten pregnancies were with twins, the population would be stable.