Actually, the picture of Rettleville on the Wiki quite clearly shows stone is the main material used in the walls and other fortifications.
Amusingly, the people are also described as displaying "some trappings of civilization but also a tinge of savage passion for the environment as one would expect from those who not only live within nature but are at one with the spirits of the woods."
