Have an option for lords to prevent peasant migration. Perhaps it shouldn't entirely prevent the peasants from moving, but at least make sure most of them remain in the region. Maybe an option to prevent them from leaving, or entering.
I don't know how realistic this is, but sometimes I want my region to grow to the max rather than having all the peasants move away.