When not at home, a text provided by the owner could be displayed. Something like: "You are warmly welcomed by a servant presenting herself as Lucilla. She has to apologise for her Lord's absence, but invites you to visit the estate and stay for coffee if you would like to." Or: "The house is in bad shape. Your servant knocks the door several times, but nobody approaches to welcome you. Either you are not wanted here, or the residents have been long gone."
The estate owner should still be messaged if someone visits, so the whole "hey, I want to talk" thing still happens.
