I think it's worth putting it into perspective. How regularly are you handling and playing vinyl? Do you keep your vinyl sealed?

Obviously any toxic off gassing is bad when compared to a baseline of "none at all", but we live in environments where we're exposed to all sorts of toxic substances daily. I suspect vinyl is unlikely to add a significant risk to health over those existing sources unless you're breathing in the off gassing all day, every day.

The environmental cost is a fair criticism. All I'd say is, if that really concerns you, that's no reason to get rid of your existing vinyl. It can't be recycled, so you may as well keep enjoying it. Just don't buy any more.