There are families that have become "familia non grata" on entire continents in the past, such that they would be hunted and banned by (nearly) every realm if they set foot there again.
These are almost invariably families that have actually done quite a bit on these continents, and in doing so, angered powerful people.
BattleMaster is an ever-changing game, and there are a host of completely in-character things that could cause a wide variety of unpleasant consequences for your particular plans, whoever you happen to be.
Having the continent sink isn't that different from being forced off of it in terms of its effect on your RP and history.