I am always viewed as an excellent worker, and I hate working. Plus, I think the better worker you are, the more people at work take advantage of you and dump more work on you, and you start to see all of these inequities--for example, your coworker who doesn't work hard and gets away with everything, but still has a job and probably gets treated better. I've been through that so much, and at my current job I am so tired of it--both just having too much dumped on me and other people getting away with being horrible workers--that I am looking for something else and can't wait to leave. But it's always the same everywhere.
As for your coworker's comment, I am sure some people feel that way about me, but I don't care. I'm not boring. You're probably not, either. But I'm at work to work, not make friends, and that's how I approach it. I am to the point where I don't want to make friends unless someone really seems interesting, and the one thing I'll say about that is when you truly get to that point that's when all these people seem to want to get to know you and be friends. Like I said, I am sure I come off as boring to some people, but to other people I come off as mysterious, shy and/or not a troublemaker (i.e. Backstabbing, drama, gossipy) or just more real/honest than others, and all of those things seem to attract people--even more than actively making an effort to make friends (which I am not trying to do--I think friendship is generally bullschitt and always ends up being too onesided/draining for my taste).
For the people who think I am boring, though, I kind of see it as an advantage. That means I can think and do things they are not aware of (like try to get horrible coworkers fired) and they won't suspect it. Like I said, I'm not boring.