Fame points do affect various things, off the top of my head being starting character h/p, starting with advanced unit types like cavalry etc. Even enough that you could be insta-lorded or instantly eligible for government positions, I think.
The hero subclass requires the same amount of prestige as government member eligibility.