The only thing you have to worry about is what Allah thinks about you.
Let the people create their own perceptions. Be the one whom Allah would like,not the one whom people would.