Actually, you could just make it so that bringing food through only the harbor is less efficient, making you lose more food than you buy. (off the top of my head number, 75 out of 100 bushels get lost due to space on ships, ships getting wrecked in storms, pirates, etc.)