How much would you like bet on this assumption? Have you ever seen your opponent in a tournament or other indication of his skill? You might be surprised at just who is the better swordsman unless you have something more then speculation to back up those claims.
I can 100% guarantee that Brom does not have a greater skill than his opponent. Although it is possible they have the same skill.