I think that's normal. People will try out Lemmy but if they notice that the communities they frequent doesn't have a lot of content they'll just leave back to reddit.

We can hope for organic growth but it'll take a long time (especially with how big reddit is)