That would in essence mean anyone with too much infamy would not be able to be an infiltrator. I like it.
I still feel that nobles do not make good infils. But I think I remember Tom saying they would be changed somehow. That information might help this discussion.
The thought was to make them more of a "spymaster" class.