Should I be concerned?

is the pain constant or just during a presumed "cycle". If the pain is the same as your menstrual cycle pain then I wouldn't worry about it, but if the pain is different and constant then go to the emergency room right away.