I'm torn, most of the time I'd agree and I do befriend co-workers myself most of the time. But I do kind of resent the fact that often people at work often come to dislike you if you aren't spending time with them during breaks/lunch.

Thing is, I know why: gossip/shit-talking about you is easier when you aren't around. I know co-workers will start shit talking other employees (or even the manager in a personal way rather than general work complaint way) and even when I myself dislike the co-worker/manager they're shit-talking myself I tend to soft-defend them because of the discomfort over talking shit about other people.

EDIT: I kind of wish people could just be more blunt/open or even confrontational and not do the Machiavellian thing. Rip the bandaid off.