Restrictions that are aggravating to players and serve no game-play purpose nor hold any RP logic all while being inconsistent with other game features.
Stepping down from a lordship is breaking an oath. It doesn't matter that what you're doing it for will be more personally advantageous to
you, you're still breaking your oath to rule and protect the people of the region you're leaving.