I've had that thought too back on the War Island. We used to retake lost lands the friendly way, but TOs took quite some time so we just went for the brutal approach, since it didn't really leave any lasting damage anyway.
It also doesn't seem to matter how many people are supporting the TO. Five nobles can take a region by 20% a turn, but twenty-five nobles will also take about that long.