I'm all for this, but maybe only with light effects on mechanics.
The automatic refusl to battle is possibly too hard a mechanic, but raising a regions morale when both the Lord and spouse are present in the region at the same time I believe is a more acceptable mechanic.
*Other acceptable mechanics may be available*