It depends on a number of factors. For this high number, I would venture they absolutely hate you, are loyal to their current realm, still have high morale (i.e. they are happy and see no reason for change), have a low desire for independence, etc. etc. ?
Many factors influence this number, and it changes when they do. But yes, 500 men seems high. I have since adjusted it a bit lower.