If you just want to do a bit of damage, you can loot 3 hours for tax gold or for food. If you want to do more damage, you can spend full hours doing the more brutal stuff.
I really don't see any interest to adding passive damage. If one wants to damage an enemy, there are already mechanics for that. There's really zero reason not to use them.
