It is anecdotal, but I used to live in an area where there I was surrounded by people who were richer and more affluent than I was. I didn't envy their stupid luxury SUVs or their unnecessarily huge houses. But it constantly gave me a feeling that I wasn't as well as I could for myself and that I should seek more. Especially when I realized how dumb some of those people who make so much more money than I do are. This ceased the moment I moved to somewhere else where people around me were at my level.

I think ultimately you want to be at the level that you perceive as "normal". But if you constantly look at people who make more than you, and there always will be, it will be much more difficult to be happy with your situation.