Why is it? Nobles are important and with the change in how infiltrators work, even they are prominent. It's basically impossible to avoid notice when you're one of the thousand most important people in the world. Villagers tend to remember that kind of stuff.
Which has nothing to do with why another noble 500 miles away would instantly know about your presence.
Unfortunately, irishlad222, this one's been argued to death for years, to no avail. It's how they want the game to function, so there you have it.