...Did I, or did I not, just say that based on the context, his remarks do not indicate that he was talking about all those who came from the Lurias to D'Hara, but only about a subset?
You claimed that. But I hardly come to the same conclusion from the quotes you presented. I said "the Lurian exiles", to which he retorted "those cheaters and abusers?"
Unless you assume "exile" only referred to people punished by a ruler's exiled button? 'cause I certainly don't. Exiles can be self-imposed.