Doubt it. All the infrastructures you will build will stay with the region you are building in.
I think once the dev team manages to add this, we will see many people sticking around with their estates.
I agree people tend to stick it out for something they've worked for rather than what was given to them. It's usually why regional lords stick around longer than the knights, they worked to gain the region and will work hard to keep it or claim a bigger more profitable one. But psychological study of the human mind proves that if they (a person) worked on it even for a small percentage of time they are more likely to stick or persevere with it even if it would be better logically to abandon it.
