In a way, I'm more inclined to look away from the person when they're speaking; I'm much more relaxed when I do it that way and can usually uphold a conversation when doing so. I often get a little guilty however, knowing that people expect me to look at them so I force myself into glancing their way once in a while. Even with people I'm most comfortable with, I still naturally look away when they're speaking and shut off visually to simply listen, so I think the 'drain' comes from when I have to maintain two senses; site and auditory. I do understand a passive glance is expected (and if I forget to consciously think about the other person, I find myself doing it anyway), but consistently maintaining eye contact?
I can remember being curious when I was younger how you were expected to look people in 'their eyes.' I could never force myself to look at both eyes simultaneously, and someone mentioned at some point to look at the space between the eyes instead, which does work but I've often found myself directly looking a person in one eye which often ends up me wondering what they're thinking with my switching back and forth like that.
When people deliberately try catching my eye, I often get slightly annoyed or uncomfortable (depending on who) as well, especially when I'm trying to hear them and ignore everything else.
I don't lack any communication skills, I can easily talk to people and get to the point of a discussion very quickly, but I usually hate this enforced 'thing' of eye-contact. It's something that's drilled into you constantly so I can't be the only person who has this 'problem?'
As an aside, I actually hate looking directly at a camera for the exact same reason! When I've recorded myself in the past, I've often struggled to keep looking forward and into the camera lens. It's a little strange looking at the footage afterwards (for both that and I hate seeing myself anyway

What're your thoughts?