I just had this in my region. It was annoying but morale got down to the 70s and loyalty to 90% or so because of it. This is for a region next to the capital with moderate taxes though.
Most annoying thing was actually just that I couldn't repair the walls because there was always 'recent fighting'