I guess (and I know this is cliched in our social circles), to put that last sentence another way, you should maintain a mental distinction between being a decent person and doing whatever it is you do to deal with your own discomfort with the idea that someone might see you as a potential threat.