I actually walked in on a friend watching that show last night. They explained to me that while the Doctor is moving forward in time, the woman is moving backwards. So, as he comes to know and love her more, she comes to know and love him less.
Of all the things on this green earth that Grif could actually afford to buy you, you chose Minecraft?