And yes, a huge cut on that time needs to be made for priests or the class will quickly become unplayable.
Actually, mixed with the idea of skill gains in prison (the idea of gaining oratory in particular) and maybe throw in some conversion abilities from within the prison (guards, prisoners, etc)....it might actually make arresting priests more interesting for both parties.
Imagine planting a seed of an opposing religion within the capital of your enemy's realm.