Nobles without units would run the risk of being robbed by rogues, captured by rogues, or injured by rogues.
And advies run the risk of being arrested or beaten in any and every region they pass through, not only rogue regions.
There is no region that is truly safe for advies.
Strange that you would be relying on the Rogues to keep you safe from other nobles though.