Yes and no. You don't need a single large unit to start the TO. However the effect of TO actions is proportional to the troops numbers, so you want large cheap units to speed up the process.
Small strong units for battle, large weak units for everything else. That's what you want.