I would try to avoid 'avoiding' people.
The more you stay away from people, the harder it is to become less nervous around them.
About 10 years back, my mom was so afraid of going out the door, that she would vomit, and become unbelievably ill before every outing. My dad had to get groceries, take us to school, everything. She just could not leave the house. That was terrible. I don't want you to get there.
To 'fix' the problem, she started counseling with a psychologist specialist doctor that helped her come to terms with her fears. She to this day swears by this gentleman, and thanks him everyday for his efforts to help her become a more social, and consequently, happy person.
She forced herself to start meeting with people. She joined a local community craft guild, and went to all the meetings.
In the beginning, she was incredibly stressed about going, and the first time she went, she drove all the way there (40 minute drive), and then turned right around just before she went in the door. She couldn't bring herself to even walk in the door (it was at a community hall).
The next time, she was able to go in the door, with the help of a anti-stress medication that her doctor prescribed. She promised herself that she would stay in the meeting for at least 30 minutes. She left the hall at exactly 31 minutes.
The next time, she met someone there that came up to her, and introduced herself. They happened to have quite a number of common interests. This gave her a much better reason to go to the guild meetings - to meet with her new friend. To this day, they still go out together almost every day.
Now, she finds that she does not need the anti-stress medication for guild meetings or general outings at all. Long-Distance Trips and Tax Time are a different story though!
Sorry for the wall of text, but I just wanted to share a bit of her story.
Please try to join a group and meet new people. They will really enrich your life.
I wish you all the best - feel free to PM me if you like.