Infiltrators need sword skill to perform their duties. Warriors need swordfighting for nothing more then tournaments. The same is true for all classes with regards to jousting. Limiting the advance of these skills based on class helps provide some measure "fairness" for all characters classes in these events.