However, because of how unpredictable and unable you would be foresee a naval landing because you can't scout sea regions, wouldn't everyone just automatically tear down their harbors during wartime to remove the possibility of sea invasion?
Harbors are for embarking. You can land anywhere, provided there are no strong defensive forces.
