You're right, it is. Neither of you should be taking anything from the other. He's supposed to be helping you, and you're miserable, and that's not fair. But all you've got now are the choices in front of you. All you can do is try to make them count.