They are untrained/unskilled in infiltrating a well-armed camp. Bandits/robbers only strike nobles with no units or very few men. Adventurers don't attack monster/undead hordes (the equivalent of a strong unit), only when they're smaller sized (though the text does refer to attacking undead armies, which isn't entirely sensible either).
