Correct. Only gold.
It is good to be a trader than, though I actually always have unit when leaving the realm since I also have more than enough gold on hand to trigger this, well that and if I help a lord out by killing monsters in his region he might be more willing to sell.