I've rarely found that the impact of a single infiltrator lives up to the hype.
You haven't seen enough good infils, then.
Hell, I've had infils who were pretty lousy by mosts' standards and still blew away hundreds of bushels of food a day. Get caught? Meh, attack another realm. No more realms left to attack? Move to another continent, resume.