One thing I've noticed is that some buildings result in active bonuses (you must do an action) while others are passive (must merely be present). I don't know how conscious/intentional you were about it originally, but it might be worth being more intentional what works best for each building. For instance, chapels could go either way, in my opinion, either spending large hours for a larger boost, or receiving a smaller boost for just being present.
