Has anyone got any advice on how to deal with being treated this way in your local community?

The fact that you are taking care of business says a lot about you. you are doing your best. You are strong. Don't feel that you have to please the world. the hell with them. You can do it on your own. Don't let the stares bother you. Sometimes we just think that we know people's thoughts. When it is probably not at all the way we are thinking. You have done nothing wrong , so just keep yourself strong and in control.