There is no geographical component to exile. But, an exiled lord would be an idiot to stray too far from his region, as it would make sabotage by diplomats/ambassadord way too easy.
His proximity in no way hinders diplomats or ambassadors. At least he can arrest priests, though, if he has a unit.