Realms will just keep more of the army as police force/home defense force to counteract those effects.
That's the point. They can't conquer their way straight to the enemy capital if they have to keep their border provinces in line. Gaining and holding a couple regions will be doable, but destroying an entire realm will take a series of wars over several in game years.
