Well, as a normal noble I got mugged within about 2 days of dropping my unit, and carrying only about 850 gold (on the very same turn that I was about to cash them in. And I lost more half).
Whereas previously as a priest, I carried 1600 for several weeks without incident.
From experience, I would say it is less likely to happen as a priest, but it does not mean it never happens.