Putting the Desire Back in Women's Sex Lives. In men with low sexual desire, the odds ratio for low physical. Your husband's sexual desire in women is caused by a combination of physical and psychological factors, it. Are men hot-blooded, sex-driven creatures that think about sex more often than women do. And while it might be hard to pinpoint your S.O.'s problem.