You're missing a key point here. A couple, actually.
One, these people who are asking you generally like you, and want you to go with them.
Two, even if they didn't, most people at a prom don't care about the people they don't know.
Three, in all likelihood, you'll go with your friends mostly...