My hunches is that it does matter, regardless of realm of affiliation (probably for coding and balance issues I guess).
Infiltrators could also become to demolition tools what traders are to caravans...
I am looking to test this soon, since the infiltrator ability to damage RC's has never been implemented so far as I know. Interestingly we have always been able to target workshops.