I don’t care about

I’ve told 3 coworkers already that I don’t talk to them

Ok so now you’re adding more information here. 3 people. this sounds less about just having some standards and more of a pattern emerging here.

What you are describing is more in line with how an APD thinks and behaves and not just a mere introvert trait.

The introversion trait isn’t attached to aversion. It’s based on personal need. No one trait needs to be rude and throw all politeness out the window. That’s bigger than a mere trait. People with introvert trait (without comorbidity) can actually talk to people and have a social ability even at work and they do not shy away from socializing full stop. They take periodic breaks based on need.

they feel offended

Again: that’s predictive.

Something doesn’t compute here. Unless you’ve misplaced yourself into a customer based industry and you’re just not a people person: Having a mere trait doesn’t end up with a collection of people aggressive at work. Nor would it be so attached to aversion and delivering hostile narrative on what other people must be thinking.

There is a proper way to break a conversation without having to be abrupt about not wanting to talk. Simply having a trait doesn’t rule over basic common decency.

You sound like you have something else going on aside from just the introvert trait.