Well... There are !@#$%^&s like me who arrests any adventurer on sight. That is probably why you have to think about keeping your head down.
If you don't want people joining your RP, say it as an OOC message. I am sure people will stay out of it if they are nice.