And if you were the religion's only priest at the moment? Or the only elder? And if that guild/religion had a ton of infrastructure and treasuries, had taken years to build?
The problem isn't often the people that betray you, but the people that can't be arsed to keep things going while you are gone.
You're describing a guild/religion that doesn't deserve to stick around. Sorry, but if the players can't be arsed to keep the stuff they built going, then there's really no hope for it.