I suggest attacking their ankles after they turn the other way, with tabaxi natural weapons and sneak attack damage.

It's a thing people will often do to cats to get their attention, which usually results in an annoyed stare in return.