it is very hard to allow people to have a wrong perception of you, without trying to justify yourself and prove that perception wrong.
but one of my favorite reminders comes from Amy Carmichael:
"If the praise of others elates me and their blame depresses me; if I cannot rest under misunderstanding without defending myself; if I love to be loved more than to love, to be served more than to serve, then I know nothing of Calvary love."
people will think what they will think. all you have control over is how YOU think. so instead, be so determinedly wrapped up in the Lord that the misunderstanding of yourself by others means nothing to you.