You can destroy enemy realms, but then your subsequent conquests would get increasingly harder, as you would be fighting nobles from all the previously destroyed realms as well.
So it's better to defeat and pacify enemy realms. Better yet, force your enemies to fight on your side.
