I have learned to just leave places, groups, relationships or acquaintances that are negative to me. There is not shame on that.
I left one group because I always asked when we were playing online, no one answered, but then I found them playing online, without me. I left the group, and kept a couple friends from there, and we still talk.
I was in this big community related to books, but it got bad, it got noisy, trolls and such, so I just left. I opened a new group with the people I did like from that group, and we are getting together this friday for some beers :D
Your time is precious, never waste your time on people that don't deserve it.