I briefly stayed at a multi-millionaire's place. They did have a herb garden. Nice planters and automated watering systems. All provided and maintained by the groundskeeping company, of course. I sincerely doubt they ever planted anything, they just grabbed herbs when they needed them and instructed people what herbs they wanted.

I imagine richer people might similarly have food gardens maintained by waitstaff. Maybe not around their primary residence, but what if the desire to cosplay as or claim to be a farmer or plantation owner strikes them?