He's confused by an inconsistency in the system. Estates work differently than regions and duchies, in both appointment and removal.
Estates can be picked up by the knight, i.e. the one lower in the hierarchy. That is why the lord, i.e. the one higher, can kick them out.
But lords and dukes are appointed by the one higher up, or elected.
