What you should do, is not look for exercises that will reduce the pain, but get to see a doctor. You need to deal with the origin of the problem, not the symptoms. If there is some serious injury, and you will keep training, you may get it worse, and it will be harder to heal later.