I now it's hard when you have nobody else, but if he says stuff like that, then you need to forget him, he isn't worth your time.
You never know when you meet new people that are potential friends. And it's better to put time in a potential friendship than to waste time on someone that doesn't...