I don't know why reformed bandits went for the Labyrinth after losing two people to it. They failed again.
When you fail a quest and lose people, I think you would be more careful and take some easy quests until you are well equipped again but these guys are absolutely crazy.