Webapr 16, 2017 · you may be able to get rid of an inner thigh pimple or boil by using natural home remedies that have antimicrobial properties that can help to soothe the infection. It’s often caused by an infection within a hair follicle or oil. Weba small bump on your inner thigh or elsewhere on your body may be a boil.