I disagree. Pagans certainly had their 'priests', in the sense that there were people who claimed to be mediums of higher powers, or prophets, or seers. They also had their places of worship, to an extent. You have to remove your idea that the general features of organized religions - constructed temples, hierarchies, and codified beliefs - are the only features that constitute a religion.