I think that part of the problem maybe that large realms have no reason to keep around the smaller realm instead of just absorbing it or creating a colony. And the problem is feeding on itself. Realms are afraid of going into war and getting destroyed, therefore there are less wars going around. With so little war around, realms have an interest to keep the war going and destroy the opposition to keep their nobles happy.