As has been said, it boils down to interests. I find people who are sports fans, even if they could care less about HBD, at least understand it. It's a way for us to feel "involved" in the sport in a way we never could in real life.
For those who aren't sports fans, we're up there with nerds who dress up in full Spock gear to watch Star Trek. Just find something you find nerdy about them to throw back when need be. Usually kills the convo pretty quick.
"You play SIM sports? Hours on a website, pouring over stats and decisions for players and teams that don't even exist? Really?"..."You and your girlfriends watch the Bachelor religiously and then spend hours incessently obsessing over a guy you don't know, will never meet, and then tearing apart the other desperate women on the show to make yourselves feel better."..."I'll be downstairs."