When you take an enemy capital that is based in a stronghold, it will still indicate that there is a bank there, but you won't be able to use it. This is because foreign capitals are where you send gold to foreign nobles. Once Averoth is deleted, the bank option will disappear from Valkyrja.
Presumably also Averothians could cash bonds?
