Hah! As a very young child my father didn't live with us for a year or so, and I definitely felt that way about him.

My (biological) parents used to tell me a story. Daddy comes home for a visit from his remote work site. Mommy says to me: "Look who's here, it's Daddy!" My response: "Daddy who?"

This apparently led to him accelerating plans to live at home again.