The problem is that the delay is there for a reason, there are other abuses possible without one. It could be an idea to stay bans if the judge is removed from office to give his successor time to check on them. That would not be too difficult, simply adding 1 day grace period to all bannings that have not yet gone into effect.
Would that solve the issue?
Yes, that would seem to make a great deal of sense, and still allows all the political intrigue you want assuming you can keep yourself in power.
