By that logic, Dukes and Lords should be barred from them as well.
Honestly though, I wish non-warriors could attend tournaments as spectators. Even better would be allowing high ranking priests to still be invited to convert/preach to nobles. A fun way to spread a faith! And get drunk!