In addition to exercising your back muscles, increasing the strength and flexibility of your hips, thighs, and stomach can help to reduce back pain. Aerobic activities like walking, biking, and swimming can help improve your physical shape. Before starting an exercise program, you should consult your doctor. Maintain a regular exercise schedule, exercising every other day. Be sure to warm up before exercise with slow, rhythmic exercises like walking.