They should develop a "warrior monk" sub-class as a compromise. You could still get robbed but you have a chance of putting up a fight depending on your swordsmanship.
Why does it need a subclass? Just having something key off of one of the combat stats would work.
Actually...Warriors getting a chance to fight off the bandits, Priests or diplomats getting a chance to talk their way out of it, infiltrators slipping away, etc might not be a bad thing. Designate a primary stat for each class or subclass, have the percentage in that stat count toward your chances...