No.
It doesn't really bother me. Somewhere along the way, I've heard/read that one word answers can be interpreted as a curt response that leads people to believe you'd rather they STFU and quit speaking to you.
I do find that a bit annoying. But, somewhere along the way, I've heard/read that it's the best way to avoid confrontation. If you're contradicted, rather than defend your position or force the other person to defend their position, you can just say "It's just how I feel. I could be wrong."