If you are on certain medications, aren't getting enough sleep, are taking birth control, or are stressed, then your sex drive may be affected.