Physically, sure you aren't. But emotionally, you're pushing him away. You keep worrying so much about him being happy that you aren't taking into account that part of that happiness is actually focused on you being content and happy as well. And so by not wanting him to worry about you, when his own happiness is intrinsically tied up with yorus, you're blocking him out emotionally.