Or risked being taken away from their parents and family and conscripted into the Janissary forces. Of course one could amass quite a lot of power within the Janissary but where also considered a special class of slaves.
That was the Ottoman Empire, with an organization quite different from the Arabic Caliphates.
But yes, your point stands, I just wanted to point that out.