This may or may not be why I tend to just avoid referring to anyone directly with any kind of pronouns if I can help it because I'm some kind of weird person.

I mean it's not actually that difficult to do once you practice it a bit. Plenty of room in the english language to maneuver around that problem.