what if, as a temp solution, you can kick. but if it's a priest of long standing/high skill, then every region with your followers will kick up a fuss - magnitude depends on follower lvl, priest's standing, etc...
Except that we don't have such a thing as a "standing".
That is exactly what I've been saying half of this discussion: We currently do not have any of the data required for making this work. Whatever we do, it requires changes to code and database.