I tend to be the same way, and that raises a good point. To make true friends, it requires spending consistent time with them. It doesn't have to be all the time, but you do have to see them regularly.
with the guys at work, have you tried talking about something that you're interested in...