Being Duke means appointing Lords, though, and that loyalty/oath is pretty big, to a normal player.
I've found it safe to assume that every Duke has a powerbase of loyal vassals to draw on. Convincing them to join a seperate cause is the only way to really undermine that duke, but it's extremely difficult to Do so.
