True, though i am not at all a fan of a realm possessing regions without a lord. In my opinion, if a region does not consistently have a lord, it should return to rouge. Say if a region is lordless for 7 days, consecutive or not, it goes rouge. 1 lordless day could be removed for every week the region is held by a lord.
I would suggest that if a region is that rubbish, don't bother TOing it in the first place. I certainly don't endorse holding on to a region and never appointing a lord.