Like all things, there's no hard rule. The
Game Rules say:
give ample chance for others to play as well
If you feel like you've given ample chance, then you probably have. Remember that there is no rule preventing you from roleplaying other characters, at least to a small degree. If you need him to move out of the doorway, you can do that. You can't make him cast magic or do anything complicated, but simple things he'd likely do are perfectly ok if you need them to continue your story.