Besides, unless your noble is a hero, he won't actually participate in battle - I believe.
Anyone leading a infantry unit can get an increase in sword fighting. I have used that fact to try and keep my infils sword fighting levels stable when I'm not actively sulking in the shadows.
