Like it or not, things sometimes become symbols for other things, and especially given the political climate, it makes sense for people to get their guard up if they see something that looks like one of those symbols that represents, say, an utterly toxic ideology.

Not wanting to make others navigate that stuff unnecessarily is a sign of thoughtfulness and pro-social tendencies, not weakness.