Appendicitis question?

Last week, I went to the hospital for pain in my left abdomen and after ultrasounds and a CT scan, and their conclusion is that its likely irritable bowel syndrome. However, their initial diagnosis was appendicitis. I had not had any pain in my right abdomen, and after tapping on my stomach a few times, they said it was not serious enough to warrant surgery at that time. Ever since I've had occasional discomforts in the right abdomen, but would not go as far as calling it severe pain. Merely a really light, dull pain or discomfort. Should I go back and have them double check my appendix? I've been told if I need my appendix out, I'll "know", but haven't had serious pains I'd expect with needing an appendectomy.