Send 4 cruisers to each colony, free clonies.
He has been known to defend his colonies, so 4 crusisers will probably take some planets but not hold them long. However, if you accompanied a mass of small crusier fleets with a few large defense fleets, you should be able to take planets rapidly and defend them long enough to get them to the stage where they can defend themselves.