Well, it's not because slavery would be allowed by the game mechanics, that all realms would do so. A gracious balance of benefits and disadvantages might just create a realistic setting, where a minority of realms maintains a slave population.
Madina, for example 
You really don't like us do you?
