Sexually only 1 temple has been closed down in a backwater region. Nobles have tried to close them down but only one has been successful. Most of the nobles who left or were kicked out have returned.
I don't think SA is gonna just disappear like you claim. Less noble followers? Sure, but all won't leave.
Give it time.
I'll close your temples, and you can't stop me.