SEX Psychological causes “Underlying anxiety or depression can get in the way of your sex drive,” Dr. Batur notes. Issues such as relationship troubles or a history Porn of sexual trauma can also affect your interest in physical intimacy.