Please be aware of the Forum Rules of Conduct.
The exiled Lord cannot be banned. The Steward (and any other knights he has) can, if they refuse to leave his service.