I think the concern would be generating a Pavlovian response to her presence instead of genuine desire to be with her, but I don't even know what that really means because our animal brains aren't rational. There isn't a such thing as "genuine" in this context because it's all based on emotions. Should you not have sex with your partner because it can make them feel attached, for example?