Simple problem to avoid. Don't talk to anyone at work, then no one will want to talk to you when you leave. It's worked for me so far. Only one I talk to are people I have to (clients, business partners etc) and my best friend (really mostly just texting). No one really from my past contacts me to "chat", they know I'm not about that chatty life.
So maybe you're just an antisocial asshole like me.