I'm not fond of the idea of limiting your martial interactions with only your neighbors, but I understand the idea. I'd prefer something which gives the players more of a choice (maybe a roaming brigand unit setting which cuts CS by half but has no problems of distance). Something that makes raiding and looting afar obviously inefficient, but at least marginally sustainable.
