You can try Orajel, (for some it helps, while others it causes more pain) Rinsing your mouth with warm salt water, alternate rinsing with 1/2 water and 1/2 peroxide too. Continue your Advil, you can take 600mg at a time as well. Moist heat compress. A good home tip is chew cloves or rub clove oil on the tooth.
The only permanent solution is to see a dentist, which you have that appt for. If it gets too severe, you can always go to the urgent care or the ER as they can then give you something for pain there.
Best of luck, Hope this helps, If you need anything else please feel free to ask. If you found this helpful don’t forget to click the *Accept* button.