Shitty wasps like Yellow Jackets give almost all the other wasps a bad reputation. Yellow Jackets are mean and spiteful, even when they aren't protecting their nest.

Most other eusocial wasps are pretty docile, unless you mess with their nest or really go out of your way to harass them.

In many parts of the world, like my own, there are far more species of solitary wasps than eusocial wasps. Solitary wasps are nearly all non-aggressive, they don't have communal nests to defend, and they basically don't have time to fuck around with stinging shit because they are too busy building a chamber for their eggs, collecting food for their upcoming progeny, and trying to stay fed and hydrated while doing it.

So what I'm getting at is that most wasps I encounter on a regular basis are pretty chill. Really, this goes for bees as well. Most of the ones I see on a regular basis are solitary types and non-aggressive. The most aggressive bees I tend to encounter are male carpenter bees. They are highly territorial and they'll even buzz a human to scare them off. However, there's no threat. Male bees and wasps cannot sting, they do not even have stingers.