Crappy in real life, great for roleplaying. Unlike a normal adventurer who can get away with being ignored a Yeoman will HAVE to be doing jobs for other nobles and be valuable to them unless he wants to suffer the wrath of some jealous knights.
Some dudes are just jerks and would like to mess up your poo poo for no reason because it's a game with no real consequences.
