Scientists haven’t broken out fertility effects by cannabinoid, so it’s tough to say if CBD, THC, or something else in cannabis is the concern. Another theory is that cannabis affects sexual desire directly in the brain. A 2017 study of cannabis users found that cannabis activated the part of people’s brains that controls sexual arousal. The authors concluded that using cannabis may be helpful for people with a low sex drive.