I have been having cramping feelings in my ovary area and I feel like I constantly need to urinate. I also haven't had my period for 3 months (I was taking Ortho-Tri-Cyclen Low). Should I be concerned?

Optional Information:
Female , Age: 26