Judging from that one instance, it seems like you said.
Also, due to the seemingly random nature of such "invisible" tolls, data would be too inconsistent to collect in large amounts to determine any potential patterns. Eh, just make sure to keep your adventurer nicely stocked with gold?