Banishment (at which point they'll likely transfer the region out of your realm), or being seriously wounded for (IIRC) five consecutive days (I believe that's the time without logging in before autopausing). I believe being imprisoned would do it as well.
EDIT: A priest could also conduct an auto da fe and have them removed if they are not the religion of the majority of the peasantry.
