Either I don't look them in the eyes or I constantly look them in the eyes and it makes them nervous, lol:P
I don't think there's anything you can do about it, just try not to think about it. If you feel at ease it would go naturally instead of forcing yourself to look into someone's eyes.