Lol lmao. The right to the fruit of something is literally one of the kinds of Roman property law that informs European ideas of property rights.

Fruit trees are mostly just expensive to grow vs other kinds and can be unappealing if fruit spoils or attracts other animals. E.g. you probably wouldn't want to play on the grass underneath an orange tree on all the little bits of orange after possums have at it.