I had some trouble with a character like this back when I was a advy. Bottom line was, after him wounding me twice, I simply used the travel advantage to out distance him. Later on when I had achieved my nobility, I duelled him to the death and buried him.
