The unit that your noble leads are soldier, trained and paid to fight. They are not common laborers. I can't imagine that anything like a labor unit would be added.
And this is why your men complain when you make them do civil works. They are not labourers.
