The refugee realms have already had their populations artificially inflated by a huge amount. Every single region in the frozen area of the EC, and in all of western Dwilight, were at 1 peasant each.
They just got there before any of you were around to notice