I think the annoyance was not about lord/earl, it was about [region name] vs [character name]. Almost nobody that I see uses the region name honorific.
Also, Earl (or the other correct title) is the preferred mode of address; Lord is the vague, "I know you're important but I don't know why" failsafe mode of address for someone you don't know at all.
