OK, then. Take action.
You know what actions will make things better for your people: Either get more of them into your realm, or move them to another realm where, together with the people who were already there, they can hold off the hordes.
Or, if your own people are doing OK, and your realm is in a good position to hold out, then step up outreach. Exhort the people in small realms, in fringe realms, to come and join you. Offer them safety, riches, semi-autonomy. Whatever it takes to save humanity, right? Especially if it's done by player action?
If you take an action, you accept the consequences of that action—and the reverse. If you desire a consequence, take the action that will result in it.
