I really don't know why people would want to ban characters like this. Maybe there was a time when, due to the tax system, they took money from other people, but that time is long gone. The game is pretty well designed so that they don't matter at all and can be safely ignored.
They do take tax from others. If they are holding an estate then they are taking taxes which would otherwise go to another knight or the lord.