Has Brom pissed off SA though? Without having all of SA after you, you hardly qualify as wanted on the continent at all.
I would say that "most wanted" is not a function purely of the number of those wanting you, but also of the "quantity, or quantitative amount of hate" that they have for you. If "most wanted" became a function of both of these, Brom easily qualifies in the top 5.
Also, Brom certainly fought against SA while in Caerwyn, even if he wasn't one of the major players. Brom has people that like him and people that hate him in nearly every cultural region on the continent.