Would you be willing to talk with me about your father? I was a patient of his when I was a boy. -Joe
From a patient-doctor point of view; I'd actually be very uncomfortable with this. He had a professional life dealing with people in a way in his professional world. He had a family which was separate. To bring those together feels like it would compromise both.
