Is my boyfriend too clingy? iin?

Okay, so my boyfriend (we were together a year and a half and apart for a year, back together again for about four months now.) Gets upset when I go home. We hang out on the weekdays towards thu and fri sometimes for a few hours, and I will spend the night at his house on saturday and we have a whole day together sunday. I don't understand why he gets mad to the point of making me feel guilty, or that I don't love him as much because I am not with him 24/7. Its like he thinks I don't value our relationship, because I have a family I want to hang out with once in a while and a room with all of my own stuff/bed/clothes. It used to be worse, I would be at his hhouse practically living there when we were first together (he lives w his parents) but I was not liking that and I missed my own home. When we are talking and apart, he is always "ho hum" and not his usual self to me. Kind of cold and it bothers me so much! Because I do love him and I wish he would realize. I know he does, he's just being a difficult. I think it might be different if he lived alone, but is it normal that he gets legit upset and takes it out on me because he thinks I don't love him when I'm away from him? What can I say to help him understand that I don't love him less just because I'm not with him at the moment?