Just means your Hero hasn't been Heroic enough. I don't get the option much but generally manage to pick up 3+ men when I do
It also matters what region you're in. Well populated city/townsland? They'll be beating down your door. Half devastated woodland? Crickets.
