It was much more difficult to put Ezra in the same space as the other characters, experiencing the same things.

Very true and I remember the few times they did have him interact with the other love interests it just looked odd, like what is this grown man doing hanging out with a bunch of high schoolers?