Not sure about building, but 100% agree with repairing.
Actually, I see stewards as managers who can maintain the region in lord's absence but should not be able to make big decisions. Like they should be able to buy food, draft and recruit troops, repair walls, fill the bounty pots and hold courts. But no bulding anything, no changing taxation settings, no estate actions, etc.
