Don't forget you have 2 weeks to perform a TO. Also, you can make other realms to banish the duke. There are many ways to deal with it until the dev team solves the issue. People should have seen this coming the moment Oligarch abandoned Southern Eponllyn.