No noble is ever "all alone". Well, except an infiltrator off on an infiltration mission.
But even he, once he returns from his successful assassination or whatever, will have at least a small retinue: personal guards, scribes, stewards, etc.
Nobles just don't travel alone. It's Not Done.
Adventures have guards as well and they are commoners.